-- Logs begin at Wed 2022-08-17 15:19:07 UTC, end at Wed 2022-08-17 16:39:42 UTC. -- Aug 17 16:04:29.768094 dv-cinder-852208-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 16:04:29.776287 dv-cinder-852208-6-smb devstack@keystone.service[81764]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 16:04:29.778451 dv-cinder-852208-6-smb devstack@keystone.service[81764]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 16:04:29 2022] *** Aug 17 16:04:29.778451 dv-cinder-852208-6-smb devstack@keystone.service[81764]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 16:04:29.778451 dv-cinder-852208-6-smb devstack@keystone.service[81764]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 16:04:29.778451 dv-cinder-852208-6-smb devstack@keystone.service[81764]: nodename: dv-cinder-852208-6-smb Aug 17 16:04:29.778451 dv-cinder-852208-6-smb devstack@keystone.service[81764]: machine: x86_64 Aug 17 16:04:29.778451 dv-cinder-852208-6-smb devstack@keystone.service[81764]: clock source: unix Aug 17 16:04:29.778451 dv-cinder-852208-6-smb devstack@keystone.service[81764]: pcre jit disabled Aug 17 16:04:29.778451 dv-cinder-852208-6-smb devstack@keystone.service[81764]: detected number of CPU cores: 4 Aug 17 16:04:29.778451 dv-cinder-852208-6-smb devstack@keystone.service[81764]: current working directory: / Aug 17 16:04:29.778451 dv-cinder-852208-6-smb devstack@keystone.service[81764]: detected binary path: /usr/bin/uwsgi-core Aug 17 16:04:29.779110 dv-cinder-852208-6-smb devstack@keystone.service[81764]: your processes number limit is 47680 Aug 17 16:04:29.779110 dv-cinder-852208-6-smb devstack@keystone.service[81764]: your memory page size is 4096 bytes Aug 17 16:04:29.779110 dv-cinder-852208-6-smb devstack@keystone.service[81764]: detected max file descriptor number: 2048 Aug 17 16:04:29.779110 dv-cinder-852208-6-smb devstack@keystone.service[81764]: lock engine: pthread robust mutexes Aug 17 16:04:29.779110 dv-cinder-852208-6-smb devstack@keystone.service[81764]: thunder lock: enabled Aug 17 16:04:29.779454 dv-cinder-852208-6-smb devstack@keystone.service[81764]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 16:04:29.779531 dv-cinder-852208-6-smb devstack@keystone.service[81764]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 16:04:29.818895 dv-cinder-852208-6-smb devstack@keystone.service[81764]: Python main interpreter initialized at 0x559ab50039c0 Aug 17 16:04:29.818895 dv-cinder-852208-6-smb devstack@keystone.service[81764]: python threads support enabled Aug 17 16:04:29.818895 dv-cinder-852208-6-smb devstack@keystone.service[81764]: your server socket listen backlog is limited to 100 connections Aug 17 16:04:29.818895 dv-cinder-852208-6-smb devstack@keystone.service[81764]: your mercy for graceful operations on workers is 90 seconds Aug 17 16:04:29.819261 dv-cinder-852208-6-smb devstack@keystone.service[81764]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 16:04:29.819336 dv-cinder-852208-6-smb devstack@keystone.service[81764]: *** Operational MODE: preforking *** Aug 17 16:04:29.819576 dv-cinder-852208-6-smb devstack@keystone.service[81764]: *** uWSGI is running in multiple interpreter mode *** Aug 17 16:04:29.819576 dv-cinder-852208-6-smb devstack@keystone.service[81764]: spawned uWSGI master process (pid: 81764) Aug 17 16:04:29.819781 dv-cinder-852208-6-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 17 16:04:29.821261 dv-cinder-852208-6-smb devstack@keystone.service[81764]: spawned uWSGI worker 1 (pid: 81777, cores: 1) Aug 17 16:04:29.821261 dv-cinder-852208-6-smb devstack@keystone.service[81764]: spawned uWSGI worker 2 (pid: 81778, cores: 1) Aug 17 16:04:29.821261 dv-cinder-852208-6-smb devstack@keystone.service[81764]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 16:04:34.117216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:04:34.117216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: from cryptography.utils import int_from_bytes Aug 17 16:04:34.118026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:04:34.118026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: from cryptography.utils import int_from_bytes Aug 17 16:04:34.118142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:04:34.118142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: from cryptography.utils import int_from_bytes Aug 17 16:04:34.118142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:04:34.118142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: from cryptography.utils import int_from_bytes Aug 17 16:04:34.167752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 16:04:34.167912 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 16:04:34.168049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] command line args: [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 16:04:34.168315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 16:04:34.168400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 16:04:34.168480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ================================================================================ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 16:04:34.168560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 16:04:34.168686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] command line args: [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 16:04:34.168765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] admin_token = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.168956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] config_dir = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.169033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 16:04:34.169135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ================================================================================ {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 16:04:34.169224 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.169304 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] config_source = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.169419 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] admin_token = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.169506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] debug = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.169699 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] config_dir = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] config_source = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] debug = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171556 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_config_append = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.171973 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_dir = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_config_append = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_dir = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_file = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.172870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.173007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.173126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.173392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.173510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.173510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.173655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.173734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.173805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.173928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.174049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.174138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.174293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.174419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.174553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.174683 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.174812 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.174934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.175058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.175058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.175297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.175433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.175555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.175682 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.175805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] publish_errors = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.175949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.176097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.176220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.176353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] publish_errors = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.176488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.176566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.176690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.176766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.176881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.177033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.177116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] standard_threads = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.177195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.177326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.183689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.183826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.183913 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] standard_threads = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.183993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.183993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] use_journal = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] use_json = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] use_stderr = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] use_syslog = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] use_journal = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184706 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] use_json = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184706 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] use_stderr = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.184917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] use_syslog = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.184987 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.185057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:04:34.185137 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.185209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.185283 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.185354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.185440 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.185520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.185671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.185745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.185821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.185898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.185974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.186997 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.187137 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.187270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.187405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.187493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.187565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.187687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.187774 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.187848 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.187918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.187999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188289 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188372 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188660 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.188963 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189316 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.189936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190530 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190822 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190894 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.190970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191047 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.191933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192079 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.192985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193304 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193631 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193893 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.193952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.194010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.194132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.194214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.194340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.194423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.194496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.194620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.194700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.194783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.194856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.194973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.195049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.195120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.195245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.195322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.195322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.195507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.195507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.195686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.195761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.195889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.196006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.196082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.196204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.196281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.196352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.196477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.196550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.196666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.196666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.196879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.196967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.197049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.197122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.197245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.197322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.197451 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.197607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.197685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.197758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.197877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.197957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.198030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.198113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.198273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.198352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.198458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.198537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.198656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.198749 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.198833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.198913 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.198986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.199057 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.199127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.199197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.199267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.199344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.199418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.199537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.199613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.199946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200243 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200312 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200529 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.200982 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.201055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.201129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.201269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.201351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.201533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.201662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.201750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.201824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.201996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.202076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.202237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.202326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.202470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.external = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.203058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.203237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.203317 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.203496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.203580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.203760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.203839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.204007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.204091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.password = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.204243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.external = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.204331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.token = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.204477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.204608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.204711 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.204787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.204955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.205052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.205186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.205266 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.password = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.205452 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.205535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.token = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.205692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.205770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210541 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.210981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211127 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211494 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211715 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.211939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212224 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.212976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.213048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.213119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.213269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.213345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.213445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.213530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.213604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.213682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.213763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.213837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.213974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214351 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214424 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214717 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.214934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215684 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215805 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.215955 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216304 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.216951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217489 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217649 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217804 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.217946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.218017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.218118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.218860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.218984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.219165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.219247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.219384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.219494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.219630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.219762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.219840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.219912 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.220073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.220155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.220315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.220397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.220557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.220676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.220806 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.220924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.221032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.221142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.221272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.221394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.221546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.221628 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.221785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.221867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.222074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.222152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.222314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.222395 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.222551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.222632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.222787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.222867 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.223039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.223119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.223285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.223366 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.223515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.223594 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.223743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.223823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.223984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.224064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.224226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.224305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.224456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.224534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.224690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.224776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.224922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.225001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.225150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.225229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.225417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.225498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.225673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.225752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.225901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.225980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.226139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.226219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.226379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.226459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.226612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.226702 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.226840 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.226910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.227082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.227175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.227300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.227389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.227532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.227613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.227764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.227844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.227990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.228079 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.228232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.228312 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.228473 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.228552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.228715 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.228807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.228955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.229036 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.229192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.229270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.229447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.229547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.229695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.229774 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.229927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.230006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.230159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.230247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.230390 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.230470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.230621 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.230701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.230861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.230949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.231103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.231183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.231336 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.231416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.231572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.231659 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.231801 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.231879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.232040 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.232119 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.232270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.232357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.232527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.232615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.232740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.232819 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.232966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.233055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.233203 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.233284 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.233453 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.233535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.233688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.233878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.234025 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.234155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.234241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.234316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.234518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.234606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.234751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.234831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.234989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.235067 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.235229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.235317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.235460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.235538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.235703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.235782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.235936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.236023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.236171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.236250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.236403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] role.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.236482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.236644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] role.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.236731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.236869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.236949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.237114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.237193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.237350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.244515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.244633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.244704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.244770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] role.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.244846 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.244908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] role.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.244988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245214 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.245951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246304 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246590 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.246957 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.247954 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248171 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248312 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.248972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249266 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249266 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249662 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249772 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249923 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.249995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250292 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250801 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.250944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.251933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252289 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252361 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252801 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.connection = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.252953 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253542 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.253996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254361 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 16:04:34.254658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.254658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.255142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:04:34.255142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 16:04:34.282885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.283108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.286917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.287061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.287061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.287061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.291767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.293382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.319392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.319612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.321049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.321280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.374031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.374188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.427331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.427331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.427528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.427528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.585521 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.585754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.585960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.586047 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.586174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.586302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.586447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.586530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.586605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.586678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.586846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.587061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.612116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.612301 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.612388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.612540 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.612657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.612743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.612818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.612963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.613055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.613176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.613258 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.613404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.613488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.613622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.624883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.625281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.647743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.647875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.647962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.648052 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.648187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.648276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.648406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.648492 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.648620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.648706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.648830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.648914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.649040 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.649125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:04:34.665574 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.665781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:04:34.666101 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.666200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.666306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:04:34.666399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:04:34.666578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.666663 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.666832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:04:34.666914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.667111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.667342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.667427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.667604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.667874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.668209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.676996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.677274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.678299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.678394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.678473 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.678559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.678559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.678559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.684761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.685552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.688187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.688466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.688749 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.689032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.689115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.689315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.689505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.689666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.689752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.689935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.690018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.690207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.690290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.690473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.690590 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.690750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.690867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.691034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.691139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.691420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.691701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.691977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.714317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.715493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.715969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.716106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.716975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.717264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.720716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.721001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.721291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.722336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.722625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.722917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.727576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.727862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.729287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.729605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.731911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.732200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.732483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.732765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.733040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.733321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.733616 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.733831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.733951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.734224 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.734521 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.734809 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.735170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.735403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.735681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.735955 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.751550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.751827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.754000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.754328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.755752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.761384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.761475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.761475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.761616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.761729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.763391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.766537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.767130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.769845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.770341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.770639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.770925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.771217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.771492 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.771767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.773030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.773337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.773651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.773940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.774222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.774613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.787656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.787943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.788223 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.788489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.790602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.790897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.791179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.791456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.795304 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.797016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.797290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.798366 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.799914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.800013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.800191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.801457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.801457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.801457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.801457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.802853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.803140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.803424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.803770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.804059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.812890 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.813169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.813483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.813764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.814040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.814311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.814588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.816418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.816711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.816999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.817282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.817587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.822181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.822181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.830712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.833750 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.834482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.839455 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.839547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.839625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.839625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.839763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.840022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.840405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.841884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.843521 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.844233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.844233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.846643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.848092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.850830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.850990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.851279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.851571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.851847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.852293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.855288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.855583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.855879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.856166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.860355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.860643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.860921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.864772 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.868181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.868181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.868374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.868374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.868374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.868581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.868806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.869076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.869346 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.869647 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.869924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.870198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.870468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.870726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.871006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.871270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.872248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:04:34.872570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.872869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.873151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.873459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.873737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.874015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.874299 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.875199 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.875648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.875940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.876211 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.876490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.876765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:04:34.905294 dv-cinder-852208-6-smb devstack@keystone.service[81778]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559ab50039c0 pid: 81778 (default app) Aug 17 16:04:34.908905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccee9e-e538-40be-9a74-a6ada821d304 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:34.909189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccee9e-e538-40be-9a74-a6ada821d304 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:34.909483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccee9e-e538-40be-9a74-a6ada821d304 None None] PATH_INFO: `/v3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:34.911242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559ab50039c0 pid: 81777 (default app) Aug 17 16:04:34.913588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Wed Aug 17 16:04:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:42.107485 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeab5da-ef3e-45ba-871e-3f8c19b32fdc None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:42.107996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeab5da-ef3e-45ba-871e-3f8c19b32fdc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:42.107996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeab5da-ef3e-45ba-871e-3f8c19b32fdc None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:42.112291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:04:42.117953 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e2e4-e9c5-44fa-9a02-46013c7f5536 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:42.118405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e2e4-e9c5-44fa-9a02-46013c7f5536 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:42.118490 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e2e4-e9c5-44fa-9a02-46013c7f5536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:42.188277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: INFO dbcounter [None req-78a6e2e4-e9c5-44fa-9a02-46013c7f5536 None None] Registered counter for database keystone Aug 17 16:04:42.207815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG oslo_db.sqlalchemy.engines [None req-78a6e2e4-e9c5-44fa-9a02-46013c7f5536 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:04:42.213890 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writer thread running {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:04:42.390857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG passlib.handlers.bcrypt [None req-78a6e2e4-e9c5-44fa-9a02-46013c7f5536 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81778) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 16:04:42.391268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG passlib.handlers.bcrypt [None req-78a6e2e4-e9c5-44fa-9a02-46013c7f5536 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81778) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 16:04:42.445610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-78a6e2e4-e9c5-44fa-9a02-46013c7f5536 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:42.447165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-78a6e2e4-e9c5-44fa-9a02-46013c7f5536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:42.572888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 17 16:04:43.016389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeab5da-ef3e-45ba-871e-3f8c19b32fdc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:43.084846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: INFO dbcounter [None req-abeab5da-ef3e-45ba-871e-3f8c19b32fdc None None] Registered counter for database keystone Aug 17 16:04:43.106790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG oslo_db.sqlalchemy.engines [None req-abeab5da-ef3e-45ba-871e-3f8c19b32fdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:04:43.113292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writer thread running {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:04:43.231005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeab5da-ef3e-45ba-871e-3f8c19b32fdc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:43.235379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3b7fc-2006-4f9a-a817-0aa01a0366de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:43.236000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b7fc-2006-4f9a-a817-0aa01a0366de admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:43.236272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b7fc-2006-4f9a-a817-0aa01a0366de admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:43.236538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b7fc-2006-4f9a-a817-0aa01a0366de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:43.244450 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3b7fc-2006-4f9a-a817-0aa01a0366de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:43.295788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: WARNING keystone.common.rbac_enforcer.enforcer [None req-32d3b7fc-2006-4f9a-a817-0aa01a0366de admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 16:04:43.296137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3b7fc-2006-4f9a-a817-0aa01a0366de admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:43.305509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Aug 17 16:04:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 16:04:43.311456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6e2e4-e9c5-44fa-9a02-46013c7f5536 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:43.326020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6e2e4-e9c5-44fa-9a02-46013c7f5536 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:43.331092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc2450-5f41-4db0-b66a-76d4ca4838b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:43.332177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc2450-5f41-4db0-b66a-76d4ca4838b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:43.332458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc2450-5f41-4db0-b66a-76d4ca4838b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:43.332732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc2450-5f41-4db0-b66a-76d4ca4838b9 admin admin] PATH_INFO: `/v3/projects/2a24cdfa264d45f188d3bf7cc23a9da7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:43.334313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc2450-5f41-4db0-b66a-76d4ca4838b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a24cdfa264d45f188d3bf7cc23a9da7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:43.386418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e4cc2450-5f41-4db0-b66a-76d4ca4838b9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 16:04:43.386761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc2450-5f41-4db0-b66a-76d4ca4838b9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:43.391742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Wed Aug 17 16:04:43 2022] GET /identity/v3/projects/2a24cdfa264d45f188d3bf7cc23a9da7 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:45.269574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fed2e-cf07-491a-823e-daf0108e88b6 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:45.270061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fed2e-cf07-491a-823e-daf0108e88b6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:45.270061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fed2e-cf07-491a-823e-daf0108e88b6 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:45.274167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:04:45.279535 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a28f8-c261-4cc4-814d-eb95cb14f96c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:45.279928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a28f8-c261-4cc4-814d-eb95cb14f96c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:45.280102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a28f8-c261-4cc4-814d-eb95cb14f96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:45.299734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cc2a28f8-c261-4cc4-814d-eb95cb14f96c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:45.301235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cc2a28f8-c261-4cc4-814d-eb95cb14f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:45.309272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 17 16:04:45.578613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fed2e-cf07-491a-823e-daf0108e88b6 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:45.590521 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fed2e-cf07-491a-823e-daf0108e88b6 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:45.594897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4400d6-9bc1-499d-8dad-82e4ed510207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:45.595486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4400d6-9bc1-499d-8dad-82e4ed510207 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:45.595759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4400d6-9bc1-499d-8dad-82e4ed510207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:45.596026 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4400d6-9bc1-499d-8dad-82e4ed510207 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:45.603589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4400d6-9bc1-499d-8dad-82e4ed510207 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:45.605352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4400d6-9bc1-499d-8dad-82e4ed510207 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:45.614515 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Aug 17 16:04:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:04:45.619789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a28f8-c261-4cc4-814d-eb95cb14f96c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:45.629418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a28f8-c261-4cc4-814d-eb95cb14f96c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:45.633837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f24d2-27d0-4d4b-b5e1-2b59e15bde86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:45.634460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f24d2-27d0-4d4b-b5e1-2b59e15bde86 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:45.634735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f24d2-27d0-4d4b-b5e1-2b59e15bde86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:45.635005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f24d2-27d0-4d4b-b5e1-2b59e15bde86 admin admin] PATH_INFO: `/v3/users/ff587d68b0de4327bd4c0d90116b3380` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:45.636296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f24d2-27d0-4d4b-b5e1-2b59e15bde86 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff587d68b0de4327bd4c0d90116b3380)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:45.638141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f24d2-27d0-4d4b-b5e1-2b59e15bde86 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:45.639654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Wed Aug 17 16:04:45 2022] GET /identity/v3/users/ff587d68b0de4327bd4c0d90116b3380 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:47.583198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca6284-005f-485a-bd5f-158669b1ff30 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:47.583751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca6284-005f-485a-bd5f-158669b1ff30 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:47.583751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca6284-005f-485a-bd5f-158669b1ff30 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:47.585077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:47.590278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50939-d611-4b27-b91e-2566bb391682 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:47.590676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50939-d611-4b27-b91e-2566bb391682 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:47.590827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50939-d611-4b27-b91e-2566bb391682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:47.609038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c4d50939-d611-4b27-b91e-2566bb391682 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:47.610241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c4d50939-d611-4b27-b91e-2566bb391682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:47.621629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6672f-eaca-4f69-92fb-dfd73eb8d39a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:47.621914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6672f-eaca-4f69-92fb-dfd73eb8d39a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:47.622185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6672f-eaca-4f69-92fb-dfd73eb8d39a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:47.623758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:04:47.628641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a562a-cac2-4c7e-a3ff-2bbc7fdb2c18 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:47.628917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a562a-cac2-4c7e-a3ff-2bbc7fdb2c18 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:47.629184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a562a-cac2-4c7e-a3ff-2bbc7fdb2c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:47.671441 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG passlib.handlers.bcrypt [None req-ad5a562a-cac2-4c7e-a3ff-2bbc7fdb2c18 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81777) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 16:04:47.671850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG passlib.handlers.bcrypt [None req-ad5a562a-cac2-4c7e-a3ff-2bbc7fdb2c18 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81777) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 16:04:47.690272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:04:47.717251 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ad5a562a-cac2-4c7e-a3ff-2bbc7fdb2c18 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:47.719640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ad5a562a-cac2-4c7e-a3ff-2bbc7fdb2c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:47.815241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:04:47.964533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d50939-d611-4b27-b91e-2566bb391682 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:47.988970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:48.072355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d50939-d611-4b27-b91e-2566bb391682 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:48.087770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a562a-cac2-4c7e-a3ff-2bbc7fdb2c18 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:48.106685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56245e-7607-4de8-a1a2-6e39fd150cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:48.107321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56245e-7607-4de8-a1a2-6e39fd150cba None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:48.107602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56245e-7607-4de8-a1a2-6e39fd150cba None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:48.107878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56245e-7607-4de8-a1a2-6e39fd150cba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:48.120377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56245e-7607-4de8-a1a2-6e39fd150cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ac56245e-7607-4de8-a1a2-6e39fd150cba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:48.129285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:48.130201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:04:48.131174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:48.136150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56245e-7607-4de8-a1a2-6e39fd150cba None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:48.191886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a562a-cac2-4c7e-a3ff-2bbc7fdb2c18 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:48.194125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:48.217936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:48.230390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf73b9-9ece-49d8-89ec-8066f001b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:48.231241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf73b9-9ece-49d8-89ec-8066f001b023 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:48.231522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf73b9-9ece-49d8-89ec-8066f001b023 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:48.231851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf73b9-9ece-49d8-89ec-8066f001b023 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:48.235536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56245e-7607-4de8-a1a2-6e39fd150cba None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:48.269522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb558e5-daaf-45e0-9af7-4df7b09865f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:48.270122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb558e5-daaf-45e0-9af7-4df7b09865f0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:48.270395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb558e5-daaf-45e0-9af7-4df7b09865f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:48.270662 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb558e5-daaf-45e0-9af7-4df7b09865f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:48.271327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb558e5-daaf-45e0-9af7-4df7b09865f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:48.271626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb558e5-daaf-45e0-9af7-4df7b09865f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:48.273016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb558e5-daaf-45e0-9af7-4df7b09865f0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:48.284747 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:48.290233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb558e5-daaf-45e0-9af7-4df7b09865f0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:48.299423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf73b9-9ece-49d8-89ec-8066f001b023 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:48.300949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf73b9-9ece-49d8-89ec-8066f001b023 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:48.397153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb558e5-daaf-45e0-9af7-4df7b09865f0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:48.406848 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:04:48.412582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf73b9-9ece-49d8-89ec-8066f001b023 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:48.415371 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:48.433500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e302c38-5f9e-413b-8b84-601c74a21f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:48.434474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302c38-5f9e-413b-8b84-601c74a21f4b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:48.434943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302c38-5f9e-413b-8b84-601c74a21f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:48.435427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302c38-5f9e-413b-8b84-601c74a21f4b None admin] PATH_INFO: `/v3/users/ff587d68b0de4327bd4c0d90116b3380` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:48.437386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e302c38-5f9e-413b-8b84-601c74a21f4b None admin] RBAC: Authorizing `identity:get_user(user_id=ff587d68b0de4327bd4c0d90116b3380)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:48.439043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e302c38-5f9e-413b-8b84-601c74a21f4b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:48.441156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:48 2022] GET /identity/v3/users/ff587d68b0de4327bd4c0d90116b3380 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:48.446774 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e302c38-5f9e-413b-8b84-601c74a21f4b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:48.461969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:48.520264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf73b9-9ece-49d8-89ec-8066f001b023 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:48.555423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b97da-f94f-4ddd-83d3-a79837ab11c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:48.556274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b97da-f94f-4ddd-83d3-a79837ab11c1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:48.556548 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b97da-f94f-4ddd-83d3-a79837ab11c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:48.556816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b97da-f94f-4ddd-83d3-a79837ab11c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:48.558677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e302c38-5f9e-413b-8b84-601c74a21f4b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:48.576452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b97da-f94f-4ddd-83d3-a79837ab11c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:48.578194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b97da-f94f-4ddd-83d3-a79837ab11c1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-485b97da-f94f-4ddd-83d3-a79837ab11c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:04:48.596287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:48.597856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:04:48.598869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:04:48.598869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:48.598869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:04:48.598869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:48.603293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b97da-f94f-4ddd-83d3-a79837ab11c1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:48.604272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73efae-d98f-440e-bec6-3c2e62ab08f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:48.604902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73efae-d98f-440e-bec6-3c2e62ab08f8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:48.605173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73efae-d98f-440e-bec6-3c2e62ab08f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:48.605476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73efae-d98f-440e-bec6-3c2e62ab08f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:48.606708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73efae-d98f-440e-bec6-3c2e62ab08f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:48.608755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73efae-d98f-440e-bec6-3c2e62ab08f8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:48.610748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:48.616093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73efae-d98f-440e-bec6-3c2e62ab08f8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:48.668852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:48.705504 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:48.712177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b97da-f94f-4ddd-83d3-a79837ab11c1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:48.724404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73efae-d98f-440e-bec6-3c2e62ab08f8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:48.746755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0d5d7-abfe-404c-bd43-d2de483e16f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:48.747362 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0d5d7-abfe-404c-bd43-d2de483e16f5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:48.747638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0d5d7-abfe-404c-bd43-d2de483e16f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:48.747904 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0d5d7-abfe-404c-bd43-d2de483e16f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:48.748540 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0d5d7-abfe-404c-bd43-d2de483e16f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:48.748866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0d5d7-abfe-404c-bd43-d2de483e16f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:48.750262 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0d5d7-abfe-404c-bd43-d2de483e16f5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:48.759765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2265ea4-583d-4bf2-be42-d0af0b20b6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:48.760372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265ea4-583d-4bf2-be42-d0af0b20b6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:48.760650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265ea4-583d-4bf2-be42-d0af0b20b6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:48.760920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265ea4-583d-4bf2-be42-d0af0b20b6e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:48.762143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2265ea4-583d-4bf2-be42-d0af0b20b6e7 None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.domain.id=default, user.id=ff587d68b0de4327bd4c0d90116b3380) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:48.762468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2265ea4-583d-4bf2-be42-d0af0b20b6e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:48.763903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2265ea4-583d-4bf2-be42-d0af0b20b6e7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:48.768632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:48.773413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 11/21] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Aug 17 16:04:48 2022] GET /identity/v3/role_assignments?user.id=ff587d68b0de4327bd4c0d90116b3380&scope.domain.id=default&role.id=28beda93f70d4c549352145ddee01aac => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:50.786545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa39a3-ca9f-4a55-a0c6-270853dd1da1 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:50.787606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa39a3-ca9f-4a55-a0c6-270853dd1da1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:50.788095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa39a3-ca9f-4a55-a0c6-270853dd1da1 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:50.789981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:50.794984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db560f-3285-4fdd-b415-755a1baf6553 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:50.795970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db560f-3285-4fdd-b415-755a1baf6553 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:50.796154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db560f-3285-4fdd-b415-755a1baf6553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:50.822386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-65db560f-3285-4fdd-b415-755a1baf6553 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:50.823608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-65db560f-3285-4fdd-b415-755a1baf6553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:50.907644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:04:51.039949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0b0cc-946c-4990-8b1b-eea22b6044bd None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:51.040246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0b0cc-946c-4990-8b1b-eea22b6044bd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:51.040416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0b0cc-946c-4990-8b1b-eea22b6044bd None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:51.041981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 12/24] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:51.047344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2215a7-2365-4d7e-b43c-6c49d6c97f51 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:51.047879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2215a7-2365-4d7e-b43c-6c49d6c97f51 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:51.048360 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2215a7-2365-4d7e-b43c-6c49d6c97f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:51.074682 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6b2215a7-2365-4d7e-b43c-6c49d6c97f51 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:51.076218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6b2215a7-2365-4d7e-b43c-6c49d6c97f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:51.163639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 13/25] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:04:51.328861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0b0cc-946c-4990-8b1b-eea22b6044bd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:51.436449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0b0cc-946c-4990-8b1b-eea22b6044bd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:51.454697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:51.473682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a164b-ed55-445d-a94a-846ed9a6e69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:51.483806 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a164b-ed55-445d-a94a-846ed9a6e69c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:51.483806 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a164b-ed55-445d-a94a-846ed9a6e69c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:51.483806 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a164b-ed55-445d-a94a-846ed9a6e69c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:51.486741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a164b-ed55-445d-a94a-846ed9a6e69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-3f4a164b-ed55-445d-a94a-846ed9a6e69c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:51.492641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:51.493567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:04:51.494885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 13/26] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:51.502476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2215a7-2365-4d7e-b43c-6c49d6c97f51 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:51.513063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:51.551971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2971-617e-4567-ae41-d2ae69a30c8f None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:51.551971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2971-617e-4567-ae41-d2ae69a30c8f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:51.551971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2971-617e-4567-ae41-d2ae69a30c8f None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:51.551971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 14/27] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:04:51.553292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed93c4-836d-4973-bebb-ae97e8298e7b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:51.553597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed93c4-836d-4973-bebb-ae97e8298e7b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:51.553872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed93c4-836d-4973-bebb-ae97e8298e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:51.581032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-09ed93c4-836d-4973-bebb-ae97e8298e7b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:51.589505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-09ed93c4-836d-4973-bebb-ae97e8298e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:51.660946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2215a7-2365-4d7e-b43c-6c49d6c97f51 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:51.675189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 15/28] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:04:51.681766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed93c4-836d-4973-bebb-ae97e8298e7b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:51.716444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7abfb-966a-4f27-8fc7-9b51e68ccda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:51.717908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7abfb-966a-4f27-8fc7-9b51e68ccda4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:51.718350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7abfb-966a-4f27-8fc7-9b51e68ccda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:51.718775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7abfb-966a-4f27-8fc7-9b51e68ccda4 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:51.719704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7abfb-966a-4f27-8fc7-9b51e68ccda4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:51.720156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7abfb-966a-4f27-8fc7-9b51e68ccda4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:51.721743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7abfb-966a-4f27-8fc7-9b51e68ccda4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:51.735862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 14/29] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:51.737318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a63c3-50b2-49d0-98e9-2b50f403d722 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:51.737761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a63c3-50b2-49d0-98e9-2b50f403d722 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:51.738201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a63c3-50b2-49d0-98e9-2b50f403d722 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:51.745640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 15/30] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:51.745640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a63c3-50b2-49d0-98e9-2b50f403d722 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:51.832039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed93c4-836d-4973-bebb-ae97e8298e7b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:51.843132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:51.882847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:51.909204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c21bbc-e332-47e8-bc84-828960e1b079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:51.909889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c21bbc-e332-47e8-bc84-828960e1b079 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:51.910169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c21bbc-e332-47e8-bc84-828960e1b079 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:51.910438 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c21bbc-e332-47e8-bc84-828960e1b079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:51.929117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a63c3-50b2-49d0-98e9-2b50f403d722 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:51.929396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c21bbc-e332-47e8-bc84-828960e1b079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:51.931000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c21bbc-e332-47e8-bc84-828960e1b079 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-c2c21bbc-e332-47e8-bc84-828960e1b079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:04:51.956664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:51.957786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:04:51.958572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:04:51.958572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:51.958572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:04:51.960326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 16/31] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:51.964234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb246c-d518-4aa2-9308-9c5080468d3f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:51.964512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb246c-d518-4aa2-9308-9c5080468d3f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:51.964779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb246c-d518-4aa2-9308-9c5080468d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:51.989015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172809d-4f21-4d98-95a4-7dcc7cda3957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:51.989674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172809d-4f21-4d98-95a4-7dcc7cda3957 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:51.990000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172809d-4f21-4d98-95a4-7dcc7cda3957 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:51.990274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172809d-4f21-4d98-95a4-7dcc7cda3957 None admin] PATH_INFO: `/v3/users/ff587d68b0de4327bd4c0d90116b3380` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:51.991443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172809d-4f21-4d98-95a4-7dcc7cda3957 None admin] RBAC: Authorizing `identity:get_user(user_id=ff587d68b0de4327bd4c0d90116b3380)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:51.992898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172809d-4f21-4d98-95a4-7dcc7cda3957 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:51.999484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 16/32] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:51 2022] GET /identity/v3/users/ff587d68b0de4327bd4c0d90116b3380 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:52.000609 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172809d-4f21-4d98-95a4-7dcc7cda3957 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:52.003778 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a1cb246c-d518-4aa2-9308-9c5080468d3f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:52.004958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a1cb246c-d518-4aa2-9308-9c5080468d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:52.102060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 17/33] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:04:52.106082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb246c-d518-4aa2-9308-9c5080468d3f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:52.138816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172809d-4f21-4d98-95a4-7dcc7cda3957 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:52.192789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05134-6127-4ec2-a166-6bee99ac432d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:52.193553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05134-6127-4ec2-a166-6bee99ac432d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:52.193838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05134-6127-4ec2-a166-6bee99ac432d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:52.194110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05134-6127-4ec2-a166-6bee99ac432d None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:52.194761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05134-6127-4ec2-a166-6bee99ac432d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:52.195060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05134-6127-4ec2-a166-6bee99ac432d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:52.197152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05134-6127-4ec2-a166-6bee99ac432d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:52.199545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:52.218607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 17/34] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:52.219457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05134-6127-4ec2-a166-6bee99ac432d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:52.282161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:52.306672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb246c-d518-4aa2-9308-9c5080468d3f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:52.335801 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05134-6127-4ec2-a166-6bee99ac432d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:52.373268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c779e-8bda-402e-b5c8-831422abd599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:52.374471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c779e-8bda-402e-b5c8-831422abd599 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:52.374751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c779e-8bda-402e-b5c8-831422abd599 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:52.375042 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c779e-8bda-402e-b5c8-831422abd599 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:52.375958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c779e-8bda-402e-b5c8-831422abd599 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:52.381396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c779e-8bda-402e-b5c8-831422abd599 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:52.401077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb2ebb-71a8-46d9-9afd-f2dcc90a4627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:52.401759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2ebb-71a8-46d9-9afd-f2dcc90a4627 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:52.402039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2ebb-71a8-46d9-9afd-f2dcc90a4627 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:52.402361 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2ebb-71a8-46d9-9afd-f2dcc90a4627 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:52.403802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb2ebb-71a8-46d9-9afd-f2dcc90a4627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:52.405613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb2ebb-71a8-46d9-9afd-f2dcc90a4627 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:52.407457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 18/35] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:52.408026 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb2ebb-71a8-46d9-9afd-f2dcc90a4627 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:52.535094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb2ebb-71a8-46d9-9afd-f2dcc90a4627 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:52.572396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec785df8-5ef1-49ce-a0c1-003e82496696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:52.573015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec785df8-5ef1-49ce-a0c1-003e82496696 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:52.573294 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec785df8-5ef1-49ce-a0c1-003e82496696 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:52.573624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec785df8-5ef1-49ce-a0c1-003e82496696 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:52.574675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec785df8-5ef1-49ce-a0c1-003e82496696 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:52.576104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec785df8-5ef1-49ce-a0c1-003e82496696 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:52.600087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 18/36] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 17 16:04:52 2022] POST /identity/v3/roles => generated 225 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:52.600887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c779e-8bda-402e-b5c8-831422abd599 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:52.782477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:52.789454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 19/37] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:04:52 2022] POST /identity/v3/projects => generated 301 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:52.790465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec785df8-5ef1-49ce-a0c1-003e82496696 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:52.805294 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:52.848555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c779e-8bda-402e-b5c8-831422abd599 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:52.892413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab8926-35a6-470a-96ab-1a4972f6321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:52.893216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab8926-35a6-470a-96ab-1a4972f6321d None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:52.893421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab8926-35a6-470a-96ab-1a4972f6321d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:52.893681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab8926-35a6-470a-96ab-1a4972f6321d None admin] PATH_INFO: `/v3/domains/default/users/ff587d68b0de4327bd4c0d90116b3380/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:52.896459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab8926-35a6-470a-96ab-1a4972f6321d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ff587d68b0de4327bd4c0d90116b3380, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:52.899600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab8926-35a6-470a-96ab-1a4972f6321d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:52.926400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec785df8-5ef1-49ce-a0c1-003e82496696 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:52.963650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969a075-e6b5-4605-871f-7bee79faae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:52.964341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969a075-e6b5-4605-871f-7bee79faae86 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:52.964623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969a075-e6b5-4605-871f-7bee79faae86 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:52.964915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969a075-e6b5-4605-871f-7bee79faae86 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:52.965658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969a075-e6b5-4605-871f-7bee79faae86 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:52.967738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969a075-e6b5-4605-871f-7bee79faae86 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:52.992924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 19/38] 10.222.0.40 () {58 vars in 1361 bytes} [Wed Aug 17 16:04:52 2022] PUT /identity/v3/domains/default/users/ff587d68b0de4327bd4c0d90116b3380/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:04:52.994282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cc797-91d3-4286-9442-a46854cb4b71 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:52.994570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cc797-91d3-4286-9442-a46854cb4b71 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:52.994839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cc797-91d3-4286-9442-a46854cb4b71 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:52.996144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 20/39] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:52.997176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95af8a-b7f3-470e-8e2f-1b7b256cdc1b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:52.997522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95af8a-b7f3-470e-8e2f-1b7b256cdc1b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:52.997859 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95af8a-b7f3-470e-8e2f-1b7b256cdc1b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:52.999352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 21/40] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:53.003215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6167b-7ae4-475f-8799-8276c519b5b4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:53.003597 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6167b-7ae4-475f-8799-8276c519b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:53.003950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6167b-7ae4-475f-8799-8276c519b5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:53.024472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d7d6167b-7ae4-475f-8799-8276c519b5b4 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:53.026185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d7d6167b-7ae4-475f-8799-8276c519b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:53.046013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 17 16:04:52 2022] POST /identity/v3/roles => generated 219 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:53.047678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f501b93-1f0a-429b-bb71-d8d5d183704f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:53.048118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f501b93-1f0a-429b-bb71-d8d5d183704f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:53.048413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f501b93-1f0a-429b-bb71-d8d5d183704f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:53.079014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8f501b93-1f0a-429b-bb71-d8d5d183704f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:53.080957 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8f501b93-1f0a-429b-bb71-d8d5d183704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:53.116920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 22/42] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:04:53.168796 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:53.175949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 21/43] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:04:53.396412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6167b-7ae4-475f-8799-8276c519b5b4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:53.443663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:53.446329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f501b93-1f0a-429b-bb71-d8d5d183704f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:53.502985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6167b-7ae4-475f-8799-8276c519b5b4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:53.542119 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b7595-d760-4caf-abc8-1c08295790d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:53.542788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b7595-d760-4caf-abc8-1c08295790d5 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:53.543461 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b7595-d760-4caf-abc8-1c08295790d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:53.543746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b7595-d760-4caf-abc8-1c08295790d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:53.544436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b7595-d760-4caf-abc8-1c08295790d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:53.546573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b7595-d760-4caf-abc8-1c08295790d5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:53.557087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f501b93-1f0a-429b-bb71-d8d5d183704f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:53.593282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50a264-f5f2-438c-af7a-0a5c4ee68966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:53.593958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50a264-f5f2-438c-af7a-0a5c4ee68966 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:53.594237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50a264-f5f2-438c-af7a-0a5c4ee68966 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:53.594509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50a264-f5f2-438c-af7a-0a5c4ee68966 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:53.595617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50a264-f5f2-438c-af7a-0a5c4ee68966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:53.597072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50a264-f5f2-438c-af7a-0a5c4ee68966 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:53.598777 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 22/44] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:53.604237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50a264-f5f2-438c-af7a-0a5c4ee68966 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:53.617741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 23/45] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 17 16:04:53 2022] POST /identity/v3/roles => generated 223 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:53.683118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:53.724078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50a264-f5f2-438c-af7a-0a5c4ee68966 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:53.763245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44077184-4851-4e4a-b557-26b3d1ea6ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:53.764414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44077184-4851-4e4a-b557-26b3d1ea6ac4 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:53.764695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44077184-4851-4e4a-b557-26b3d1ea6ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:53.764932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44077184-4851-4e4a-b557-26b3d1ea6ac4 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:53.765759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44077184-4851-4e4a-b557-26b3d1ea6ac4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:53.767208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44077184-4851-4e4a-b557-26b3d1ea6ac4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:53.885801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 23/46] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:04:53 2022] POST /identity/v3/projects => generated 312 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:04:54.940881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41421c-3d81-4faf-8176-ec53fb601db7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:54.941393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41421c-3d81-4faf-8176-ec53fb601db7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:54.941479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41421c-3d81-4faf-8176-ec53fb601db7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:54.942879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 24/47] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:54.948286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3aa5-471a-4304-8ab3-a973ae9e88cc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:54.948965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3aa5-471a-4304-8ab3-a973ae9e88cc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:54.949104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3aa5-471a-4304-8ab3-a973ae9e88cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:54.968440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f74f3aa5-471a-4304-8ab3-a973ae9e88cc None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:54.969694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f74f3aa5-471a-4304-8ab3-a973ae9e88cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:55.036179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 24/48] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:04:55.309318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41421c-3d81-4faf-8176-ec53fb601db7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:55.410204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41421c-3d81-4faf-8176-ec53fb601db7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:55.412526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:55.445200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d50836-4bbb-4d83-bd75-3b0954e65d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:55.445870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d50836-4bbb-4d83-bd75-3b0954e65d4f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:55.446154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d50836-4bbb-4d83-bd75-3b0954e65d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:55.446468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d50836-4bbb-4d83-bd75-3b0954e65d4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:55.458815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d50836-4bbb-4d83-bd75-3b0954e65d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d4d50836-4bbb-4d83-bd75-3b0954e65d4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:55.463604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:55.464579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:04:55.465348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 25/49] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:55.471563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f3aa5-471a-4304-8ab3-a973ae9e88cc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:55.519794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:55.570906 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f3aa5-471a-4304-8ab3-a973ae9e88cc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:55.603834 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc29666-8d2d-480c-9ea6-7c217d6992ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:55.604447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29666-8d2d-480c-9ea6-7c217d6992ea None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:55.604727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29666-8d2d-480c-9ea6-7c217d6992ea None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:55.605001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29666-8d2d-480c-9ea6-7c217d6992ea None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:55.605705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc29666-8d2d-480c-9ea6-7c217d6992ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:55.606007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc29666-8d2d-480c-9ea6-7c217d6992ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:55.607403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc29666-8d2d-480c-9ea6-7c217d6992ea None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:55.619513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 25/50] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:55.625357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d50836-4bbb-4d83-bd75-3b0954e65d4f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:55.723585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d50836-4bbb-4d83-bd75-3b0954e65d4f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:55.756472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3876a52-3a03-4f1b-a438-1bb18b09dd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:55.757096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3876a52-3a03-4f1b-a438-1bb18b09dd5b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:55.757387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3876a52-3a03-4f1b-a438-1bb18b09dd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:55.757667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3876a52-3a03-4f1b-a438-1bb18b09dd5b None admin] PATH_INFO: `/v3/users/ff587d68b0de4327bd4c0d90116b3380` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:55.758784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3876a52-3a03-4f1b-a438-1bb18b09dd5b None admin] RBAC: Authorizing `identity:get_user(user_id=ff587d68b0de4327bd4c0d90116b3380)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:55.760249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3876a52-3a03-4f1b-a438-1bb18b09dd5b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:55.761850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 26/51] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:55 2022] GET /identity/v3/users/ff587d68b0de4327bd4c0d90116b3380 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:55.767445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc29666-8d2d-480c-9ea6-7c217d6992ea None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:55.798977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9334-ce1d-4065-a33a-662e3f3a25b1 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:55.799249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9334-ce1d-4065-a33a-662e3f3a25b1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:55.799515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9334-ce1d-4065-a33a-662e3f3a25b1 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:55.800831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 27/52] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:04:55.805609 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dd6c0-6e4f-4e70-9a40-e9b7dfbf0404 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:55.805890 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dd6c0-6e4f-4e70-9a40-e9b7dfbf0404 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:55.806163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dd6c0-6e4f-4e70-9a40-e9b7dfbf0404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:55.823354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-686dd6c0-6e4f-4e70-9a40-e9b7dfbf0404 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:55.824738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-686dd6c0-6e4f-4e70-9a40-e9b7dfbf0404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:55.851737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:55.868474 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc29666-8d2d-480c-9ea6-7c217d6992ea None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:55.881076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:55.892826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 28/53] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:04:55.903845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174e1f6-9eae-4470-8efa-42e0e3f6a17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:55.905121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174e1f6-9eae-4470-8efa-42e0e3f6a17b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:55.905421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174e1f6-9eae-4470-8efa-42e0e3f6a17b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:55.905697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174e1f6-9eae-4470-8efa-42e0e3f6a17b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:55.906816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174e1f6-9eae-4470-8efa-42e0e3f6a17b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:55.908263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174e1f6-9eae-4470-8efa-42e0e3f6a17b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:55.910018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 26/54] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:55.915607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dd6c0-6e4f-4e70-9a40-e9b7dfbf0404 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:56.013604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dd6c0-6e4f-4e70-9a40-e9b7dfbf0404 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:56.047375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30333c2-6f56-40b8-8ba3-b8b88035ce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:56.047978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30333c2-6f56-40b8-8ba3-b8b88035ce78 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:56.048256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30333c2-6f56-40b8-8ba3-b8b88035ce78 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:56.048527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30333c2-6f56-40b8-8ba3-b8b88035ce78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:56.049248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30333c2-6f56-40b8-8ba3-b8b88035ce78 None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.domain.id=default, user.id=ff587d68b0de4327bd4c0d90116b3380) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:56.049580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30333c2-6f56-40b8-8ba3-b8b88035ce78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:56.051013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30333c2-6f56-40b8-8ba3-b8b88035ce78 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:56.056572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 29/55] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Aug 17 16:04:55 2022] GET /identity/v3/role_assignments?user.id=ff587d68b0de4327bd4c0d90116b3380&scope.domain.id=default&role.id=28beda93f70d4c549352145ddee01aac => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:56.165635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174e1f6-9eae-4470-8efa-42e0e3f6a17b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:56.372033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174e1f6-9eae-4470-8efa-42e0e3f6a17b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:56.405220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e94de3-b9a4-4e57-b9af-12e77f8ecc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:56.405869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e94de3-b9a4-4e57-b9af-12e77f8ecc3f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:56.406149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e94de3-b9a4-4e57-b9af-12e77f8ecc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:56.406421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e94de3-b9a4-4e57-b9af-12e77f8ecc3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:56.407517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e94de3-b9a4-4e57-b9af-12e77f8ecc3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:56.408949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e94de3-b9a4-4e57-b9af-12e77f8ecc3f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:56.410543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 27/56] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:56.416177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30333c2-6f56-40b8-8ba3-b8b88035ce78 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:56.443339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:56.513459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30333c2-6f56-40b8-8ba3-b8b88035ce78 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:56.546233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf693f-8194-435f-8f27-7c8fb54ab19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:56.546833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf693f-8194-435f-8f27-7c8fb54ab19b None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:56.547109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf693f-8194-435f-8f27-7c8fb54ab19b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:56.547376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf693f-8194-435f-8f27-7c8fb54ab19b None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:56.548007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf693f-8194-435f-8f27-7c8fb54ab19b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:56.549477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf693f-8194-435f-8f27-7c8fb54ab19b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:56.627467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 30/57] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Aug 17 16:04:56 2022] POST /identity/v3/projects => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:58.534782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d47ea-06c0-4892-9124-ae20514fd150 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:58.535303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d47ea-06c0-4892-9124-ae20514fd150 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:58.535303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d47ea-06c0-4892-9124-ae20514fd150 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:58.536670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 28/58] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:58.541959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df258b3-3555-416b-805e-a96490555952 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:58.542364 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df258b3-3555-416b-805e-a96490555952 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:58.542512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df258b3-3555-416b-805e-a96490555952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:58.561358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3df258b3-3555-416b-805e-a96490555952 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:58.562564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3df258b3-3555-416b-805e-a96490555952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:58.627500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 31/59] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:04:58.897347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d47ea-06c0-4892-9124-ae20514fd150 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:58.944381 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:58.998624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d47ea-06c0-4892-9124-ae20514fd150 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:59.032702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510b14f-367f-4b30-922d-85c2dd335130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:59.033331 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510b14f-367f-4b30-922d-85c2dd335130 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:59.033645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510b14f-367f-4b30-922d-85c2dd335130 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:59.033918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510b14f-367f-4b30-922d-85c2dd335130 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:59.035032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510b14f-367f-4b30-922d-85c2dd335130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:59.036478 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510b14f-367f-4b30-922d-85c2dd335130 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:59.038086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 29/60] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:59.043625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df258b3-3555-416b-805e-a96490555952 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:59.053944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:59.143101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df258b3-3555-416b-805e-a96490555952 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:59.176623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630915f-2957-42b4-a590-a806522835fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:59.177167 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630915f-2957-42b4-a590-a806522835fa None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:59.177477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630915f-2957-42b4-a590-a806522835fa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:59.177754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630915f-2957-42b4-a590-a806522835fa None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:59.178404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630915f-2957-42b4-a590-a806522835fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:59.179905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630915f-2957-42b4-a590-a806522835fa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:59.271873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 32/61] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:04:59 2022] POST /identity/v3/users => generated 275 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:02.247455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139b9bc-e692-4ade-85e4-9903391ec06f None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:02.248477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139b9bc-e692-4ade-85e4-9903391ec06f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:02.248568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139b9bc-e692-4ade-85e4-9903391ec06f None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:02.250286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 30/62] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:02.255735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd26600-fe42-42e2-9e95-8d1a339e7991 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:02.256151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd26600-fe42-42e2-9e95-8d1a339e7991 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:02.256321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd26600-fe42-42e2-9e95-8d1a339e7991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:02.277407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4cd26600-fe42-42e2-9e95-8d1a339e7991 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:02.278620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4cd26600-fe42-42e2-9e95-8d1a339e7991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:02.373269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:02.388023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 33/63] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:02.418664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81103dc-985a-4a30-849c-ca784815d33b None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:02.419264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81103dc-985a-4a30-849c-ca784815d33b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:02.419831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81103dc-985a-4a30-849c-ca784815d33b None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:02.421692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 31/64] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:02.427576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5007fe-1a52-4f51-9771-025b881debc1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:02.427868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5007fe-1a52-4f51-9771-025b881debc1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:02.428150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5007fe-1a52-4f51-9771-025b881debc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:02.449964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fe5007fe-1a52-4f51-9771-025b881debc1 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:02.452249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fe5007fe-1a52-4f51-9771-025b881debc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:02.460254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adba568-9800-4e94-b9f2-5498663c99d4 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:02.460541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adba568-9800-4e94-b9f2-5498663c99d4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:02.460876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adba568-9800-4e94-b9f2-5498663c99d4 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:02.462248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 32/65] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:05:02.474712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cfa12-4a04-4ae5-b603-b15bfcab2915 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:02.474992 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cfa12-4a04-4ae5-b603-b15bfcab2915 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:02.475263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cfa12-4a04-4ae5-b603-b15bfcab2915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:02.504973 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-493cfa12-4a04-4ae5-b603-b15bfcab2915 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:02.506126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-493cfa12-4a04-4ae5-b603-b15bfcab2915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:02.569744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 34/66] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:02.631224 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 33/67] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:02.721537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5007fe-1a52-4f51-9771-025b881debc1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:02.826476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5007fe-1a52-4f51-9771-025b881debc1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:02.850910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:02.870918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8721e-51de-4889-a660-e3e924e20930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:02.871840 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8721e-51de-4889-a660-e3e924e20930 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:02.872280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8721e-51de-4889-a660-e3e924e20930 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:02.872778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8721e-51de-4889-a660-e3e924e20930 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:02.884170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8721e-51de-4889-a660-e3e924e20930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e4b8721e-51de-4889-a660-e3e924e20930 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:02.889379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:02.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:02.890934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:02.892885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 35/68] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:02.900869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cfa12-4a04-4ae5-b603-b15bfcab2915 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:02.916561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8721e-51de-4889-a660-e3e924e20930 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:02.976410 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:03.030789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8721e-51de-4889-a660-e3e924e20930 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:03.036637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cfa12-4a04-4ae5-b603-b15bfcab2915 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:03.065755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b08f-c600-4d82-ba1a-3a39d0427095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:03.066373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b08f-c600-4d82-ba1a-3a39d0427095 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.066651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b08f-c600-4d82-ba1a-3a39d0427095 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.066923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b08f-c600-4d82-ba1a-3a39d0427095 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.077961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0b08f-c600-4d82-ba1a-3a39d0427095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:03.078762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e89fe-edeb-4118-a10c-223fab5607f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:03.079379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e89fe-edeb-4118-a10c-223fab5607f5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.079658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e89fe-edeb-4118-a10c-223fab5607f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.079929 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e89fe-edeb-4118-a10c-223fab5607f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.080602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e89fe-edeb-4118-a10c-223fab5607f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:03.080950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e89fe-edeb-4118-a10c-223fab5607f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:03.082372 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e89fe-edeb-4118-a10c-223fab5607f5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-fbd0b08f-c600-4d82-ba1a-3a39d0427095 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:03.082557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:03.083358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:03.084134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 36/69] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:03.084757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b08f-c600-4d82-ba1a-3a39d0427095 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:03.095557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 34/70] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:03.095557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2e1bb-86ec-4550-a584-15683c32a5bd None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.095557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2e1bb-86ec-4550-a584-15683c32a5bd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.095557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2e1bb-86ec-4550-a584-15683c32a5bd None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.096047 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 35/71] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:03.096837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2e1bb-86ec-4550-a584-15683c32a5bd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:03.133015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:03.185873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b08f-c600-4d82-ba1a-3a39d0427095 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:03.199485 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2e1bb-86ec-4550-a584-15683c32a5bd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:03.208135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:03.220408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a1c9c-e13b-4a1a-a35b-a77f82256c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:03.221039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1c9c-e13b-4a1a-a35b-a77f82256c49 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.221317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1c9c-e13b-4a1a-a35b-a77f82256c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.221619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1c9c-e13b-4a1a-a35b-a77f82256c49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.231342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a1c9c-e13b-4a1a-a35b-a77f82256c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:03.233643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f276ff-7d5a-4941-9e3d-94974fc7e585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:03.234244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f276ff-7d5a-4941-9e3d-94974fc7e585 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.234516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f276ff-7d5a-4941-9e3d-94974fc7e585 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.234779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f276ff-7d5a-4941-9e3d-94974fc7e585 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.235428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f276ff-7d5a-4941-9e3d-94974fc7e585 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:03.235722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f276ff-7d5a-4941-9e3d-94974fc7e585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-777a1c9c-e13b-4a1a-a35b-a77f82256c49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:03.236113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:03.237038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:03.238045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:03.238628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f276ff-7d5a-4941-9e3d-94974fc7e585 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:03.238694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 37/72] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:03.238694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a1c9c-e13b-4a1a-a35b-a77f82256c49 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:03.246112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:03.247275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805aeeb-705b-4a32-82d0-b269a508eaf6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.247557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805aeeb-705b-4a32-82d0-b269a508eaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.248586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805aeeb-705b-4a32-82d0-b269a508eaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.265814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4805aeeb-705b-4a32-82d0-b269a508eaf6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:03.266999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4805aeeb-705b-4a32-82d0-b269a508eaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:03.335789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 37/74] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:03.336939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561b02-54bd-4ea2-9f61-443a9cca7104 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.337206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561b02-54bd-4ea2-9f61-443a9cca7104 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.337509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561b02-54bd-4ea2-9f61-443a9cca7104 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.338746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 38/75] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:03.343136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561b02-54bd-4ea2-9f61-443a9cca7104 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:03.343495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a1c9c-e13b-4a1a-a35b-a77f82256c49 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:03.346630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:03.379589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb964cb-52d2-4440-ba79-da2c250ca4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:03.380190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb964cb-52d2-4440-ba79-da2c250ca4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.380491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb964cb-52d2-4440-ba79-da2c250ca4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.380776 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb964cb-52d2-4440-ba79-da2c250ca4f4 None admin] PATH_INFO: `/v3/users/7d8d47bc48854f978d82fae1c6ad4c94` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.394850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb964cb-52d2-4440-ba79-da2c250ca4f4 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8d47bc48854f978d82fae1c6ad4c94)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:03.396337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb964cb-52d2-4440-ba79-da2c250ca4f4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:03.398195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 38/76] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:03 2022] GET /identity/v3/users/7d8d47bc48854f978d82fae1c6ad4c94 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:03.398802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb964cb-52d2-4440-ba79-da2c250ca4f4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:03.457355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:03.462117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561b02-54bd-4ea2-9f61-443a9cca7104 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:03.499335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e1bf9-e4ec-4d10-a375-4af30e0cce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:03.499950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1bf9-e4ec-4d10-a375-4af30e0cce97 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.500225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1bf9-e4ec-4d10-a375-4af30e0cce97 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.500489 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1bf9-e4ec-4d10-a375-4af30e0cce97 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.501153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e1bf9-e4ec-4d10-a375-4af30e0cce97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:03.501482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e1bf9-e4ec-4d10-a375-4af30e0cce97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:03.502862 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e1bf9-e4ec-4d10-a375-4af30e0cce97 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:03.504986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb964cb-52d2-4440-ba79-da2c250ca4f4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:03.511037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 39/77] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:03.512369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeab46a-3081-4c53-8f1c-f26795e9dd59 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.512821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeab46a-3081-4c53-8f1c-f26795e9dd59 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.513249 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeab46a-3081-4c53-8f1c-f26795e9dd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.531117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-adeab46a-3081-4c53-8f1c-f26795e9dd59 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:03.532515 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-adeab46a-3081-4c53-8f1c-f26795e9dd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:03.544233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118572a7-5ec3-4040-ae1f-3509abf9f1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:03.545605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118572a7-5ec3-4040-ae1f-3509abf9f1dd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.545887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118572a7-5ec3-4040-ae1f-3509abf9f1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.546163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118572a7-5ec3-4040-ae1f-3509abf9f1dd None admin] PATH_INFO: `/v3/users/7d8d47bc48854f978d82fae1c6ad4c94` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.547286 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118572a7-5ec3-4040-ae1f-3509abf9f1dd None admin] RBAC: Authorizing `identity:get_user(user_id=7d8d47bc48854f978d82fae1c6ad4c94)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:03.548742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118572a7-5ec3-4040-ae1f-3509abf9f1dd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:03.550358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 39/78] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:03 2022] GET /identity/v3/users/7d8d47bc48854f978d82fae1c6ad4c94 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:03.551114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118572a7-5ec3-4040-ae1f-3509abf9f1dd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:03.583355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:03.610002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 40/79] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:03.611074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeab46a-3081-4c53-8f1c-f26795e9dd59 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:03.663876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118572a7-5ec3-4040-ae1f-3509abf9f1dd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:03.699627 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac651f5d-9174-48af-acb7-d892c654e166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:03.700451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac651f5d-9174-48af-acb7-d892c654e166 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.700810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac651f5d-9174-48af-acb7-d892c654e166 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.701230 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac651f5d-9174-48af-acb7-d892c654e166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.708089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:03.718411 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeab46a-3081-4c53-8f1c-f26795e9dd59 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:03.755661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59489421-7abb-445b-8272-22b3803bd9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:03.756374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489421-7abb-445b-8272-22b3803bd9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.756635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489421-7abb-445b-8272-22b3803bd9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.756903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489421-7abb-445b-8272-22b3803bd9b1 None admin] PATH_INFO: `/v3/users/ff587d68b0de4327bd4c0d90116b3380` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.758399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59489421-7abb-445b-8272-22b3803bd9b1 None admin] RBAC: Authorizing `identity:get_user(user_id=ff587d68b0de4327bd4c0d90116b3380)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:03.759750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59489421-7abb-445b-8272-22b3803bd9b1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:03.761724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 41/80] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:03 2022] GET /identity/v3/users/ff587d68b0de4327bd4c0d90116b3380 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:03.762112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59489421-7abb-445b-8272-22b3803bd9b1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:03.777974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac651f5d-9174-48af-acb7-d892c654e166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:03.780484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac651f5d-9174-48af-acb7-d892c654e166 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:03.820538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:03.867915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59489421-7abb-445b-8272-22b3803bd9b1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:03.900307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 40/81] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:03.901030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac651f5d-9174-48af-acb7-d892c654e166 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:03.910225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a459f2-4743-4d5b-8aed-6e5a9ffa0f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:03.910842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a459f2-4743-4d5b-8aed-6e5a9ffa0f2d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:03.911120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a459f2-4743-4d5b-8aed-6e5a9ffa0f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:03.911388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a459f2-4743-4d5b-8aed-6e5a9ffa0f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:03.938885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:03.980556 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a459f2-4743-4d5b-8aed-6e5a9ffa0f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:03.982104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a459f2-4743-4d5b-8aed-6e5a9ffa0f2d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:04.003320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac651f5d-9174-48af-acb7-d892c654e166 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:04.030533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:04.036467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dd676-9729-46c1-b4d8-3b05ff465560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:04.037096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd676-9729-46c1-b4d8-3b05ff465560 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:04.041122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd676-9729-46c1-b4d8-3b05ff465560 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:04.041122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd676-9729-46c1-b4d8-3b05ff465560 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:04.041122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dd676-9729-46c1-b4d8-3b05ff465560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:04.041122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dd676-9729-46c1-b4d8-3b05ff465560 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:04.041811 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 41/82] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:04.042569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dd676-9729-46c1-b4d8-3b05ff465560 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:04.080108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 42/83] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:04.080950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a459f2-4743-4d5b-8aed-6e5a9ffa0f2d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:04.137683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:04.146537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dd676-9729-46c1-b4d8-3b05ff465560 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:04.179155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a459f2-4743-4d5b-8aed-6e5a9ffa0f2d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:04.181376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c96206-4bcf-4a70-a4bb-3f6a4da306be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:04.181996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c96206-4bcf-4a70-a4bb-3f6a4da306be None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:04.182277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c96206-4bcf-4a70-a4bb-3f6a4da306be None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:04.182556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c96206-4bcf-4a70-a4bb-3f6a4da306be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:04.213593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155c4a-2ec8-4577-8a9c-cb3fa357d7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:04.214224 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155c4a-2ec8-4577-8a9c-cb3fa357d7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:04.214502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155c4a-2ec8-4577-8a9c-cb3fa357d7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:04.214770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155c4a-2ec8-4577-8a9c-cb3fa357d7f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:04.224649 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45155c4a-2ec8-4577-8a9c-cb3fa357d7f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-45155c4a-2ec8-4577-8a9c-cb3fa357d7f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:04.229761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:04.230666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:04.231425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 43/84] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:04.232606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155c4a-2ec8-4577-8a9c-cb3fa357d7f5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:04.250342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:04.253844 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c96206-4bcf-4a70-a4bb-3f6a4da306be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:04.255323 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c96206-4bcf-4a70-a4bb-3f6a4da306be None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:04.336032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155c4a-2ec8-4577-8a9c-cb3fa357d7f5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:04.352382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 42/85] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:04.353171 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:04.353282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c96206-4bcf-4a70-a4bb-3f6a4da306be None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:04.374672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04dbdd-ac8f-4675-8ba9-dccbf797909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:04.375311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04dbdd-ac8f-4675-8ba9-dccbf797909a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:04.375588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04dbdd-ac8f-4675-8ba9-dccbf797909a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:04.375862 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04dbdd-ac8f-4675-8ba9-dccbf797909a None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:04.377110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04dbdd-ac8f-4675-8ba9-dccbf797909a None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:04.378670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04dbdd-ac8f-4675-8ba9-dccbf797909a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:04.385022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 44/86] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:04 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:04.385022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04dbdd-ac8f-4675-8ba9-dccbf797909a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:04.447932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:04.452435 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c96206-4bcf-4a70-a4bb-3f6a4da306be None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:04.481483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04dbdd-ac8f-4675-8ba9-dccbf797909a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:04.487261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80c73d-f9f0-4e79-9ca3-b47f4e502c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:04.487871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c73d-f9f0-4e79-9ca3-b47f4e502c52 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:04.488150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c73d-f9f0-4e79-9ca3-b47f4e502c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:04.488421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80c73d-f9f0-4e79-9ca3-b47f4e502c52 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:04.489067 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80c73d-f9f0-4e79-9ca3-b47f4e502c52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:04.490545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80c73d-f9f0-4e79-9ca3-b47f4e502c52 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:04.514548 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773f719-cbdf-4871-8a96-128eea8e8326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:04.515178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773f719-cbdf-4871-8a96-128eea8e8326 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:04.515465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773f719-cbdf-4871-8a96-128eea8e8326 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:04.515742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773f719-cbdf-4871-8a96-128eea8e8326 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:04.516872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773f719-cbdf-4871-8a96-128eea8e8326 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:04.518416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773f719-cbdf-4871-8a96-128eea8e8326 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:04.520037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 45/87] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:04 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:04.520797 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773f719-cbdf-4871-8a96-128eea8e8326 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:04.575043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:04.610006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 43/88] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:04 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:04.610845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80c73d-f9f0-4e79-9ca3-b47f4e502c52 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:04.621958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773f719-cbdf-4871-8a96-128eea8e8326 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:04.663550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc49331-184b-4818-8c10-ab261a92622a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:04.664589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49331-184b-4818-8c10-ab261a92622a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:04.664866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49331-184b-4818-8c10-ab261a92622a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:04.665153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49331-184b-4818-8c10-ab261a92622a None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:04.665884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc49331-184b-4818-8c10-ab261a92622a None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:04.666192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc49331-184b-4818-8c10-ab261a92622a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:04.667636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc49331-184b-4818-8c10-ab261a92622a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:04.678241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 46/89] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:04.683790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc49331-184b-4818-8c10-ab261a92622a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:04.737884 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80c73d-f9f0-4e79-9ca3-b47f4e502c52 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:04.779974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c65915-a2d3-4e26-82e8-7e61706d2d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:04.780625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c65915-a2d3-4e26-82e8-7e61706d2d05 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:04.780904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c65915-a2d3-4e26-82e8-7e61706d2d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:04.781234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c65915-a2d3-4e26-82e8-7e61706d2d05 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:04.782418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c65915-a2d3-4e26-82e8-7e61706d2d05 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:04.783899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c65915-a2d3-4e26-82e8-7e61706d2d05 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:04.785784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 44/90] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:04 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:04.786347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c65915-a2d3-4e26-82e8-7e61706d2d05 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:04.804207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc49331-184b-4818-8c10-ab261a92622a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:04.813512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:04.822915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:04.840963 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a9761-b095-487f-a470-7e85f5fec21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:04.845486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a9761-b095-487f-a470-7e85f5fec21f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:04.845486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a9761-b095-487f-a470-7e85f5fec21f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:04.845486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a9761-b095-487f-a470-7e85f5fec21f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:04.845486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a9761-b095-487f-a470-7e85f5fec21f None admin] RBAC: Adding query filter params (role.id=a64cd92139fb4f1fb64f05f5a88f999f, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad, user.id=7d8d47bc48854f978d82fae1c6ad4c94) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:04.845486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a9761-b095-487f-a470-7e85f5fec21f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:04.845486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a9761-b095-487f-a470-7e85f5fec21f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:04.855180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 47/91] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:04 2022] GET /identity/v3/role_assignments?user.id=7d8d47bc48854f978d82fae1c6ad4c94&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:04.855818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a9761-b095-487f-a470-7e85f5fec21f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:04.917259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c65915-a2d3-4e26-82e8-7e61706d2d05 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:04.974170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee72de-7581-4e42-be1f-6d57340e5e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:04.975182 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee72de-7581-4e42-be1f-6d57340e5e42 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:04.975668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee72de-7581-4e42-be1f-6d57340e5e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:04.976138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee72de-7581-4e42-be1f-6d57340e5e42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:04.976894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee72de-7581-4e42-be1f-6d57340e5e42 None admin] RBAC: Adding query filter params (role.id=68da777efbc34e15a79e851577a8ee89, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad, user.id=7d8d47bc48854f978d82fae1c6ad4c94) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:04.977208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee72de-7581-4e42-be1f-6d57340e5e42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:04.978748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee72de-7581-4e42-be1f-6d57340e5e42 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:04.985220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 45/92] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:04 2022] GET /identity/v3/role_assignments?user.id=7d8d47bc48854f978d82fae1c6ad4c94&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=68da777efbc34e15a79e851577a8ee89 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:04.986153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee72de-7581-4e42-be1f-6d57340e5e42 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:04.996771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a9761-b095-487f-a470-7e85f5fec21f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:05.050727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206538d-2a41-4819-bf02-a4609cf111c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:05.051402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206538d-2a41-4819-bf02-a4609cf111c9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:05.051857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206538d-2a41-4819-bf02-a4609cf111c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:05.052137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206538d-2a41-4819-bf02-a4609cf111c9 None admin] PATH_INFO: `/v3/users/7d8d47bc48854f978d82fae1c6ad4c94` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:05.054364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206538d-2a41-4819-bf02-a4609cf111c9 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8d47bc48854f978d82fae1c6ad4c94)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:05.056131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206538d-2a41-4819-bf02-a4609cf111c9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:05.058127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 48/93] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:04 2022] GET /identity/v3/users/7d8d47bc48854f978d82fae1c6ad4c94 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:05.064158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206538d-2a41-4819-bf02-a4609cf111c9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:05.123534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:05.134813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:05.173597 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee72de-7581-4e42-be1f-6d57340e5e42 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:05.186744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206538d-2a41-4819-bf02-a4609cf111c9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:05.229486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f841-010b-421b-a865-2c924327028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:05.230364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f841-010b-421b-a865-2c924327028c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:05.230850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f841-010b-421b-a865-2c924327028c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:05.231198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f841-010b-421b-a865-2c924327028c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:05.268041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363c030-ec28-4251-ab90-b00d9b1ab349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:05.268586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c030-ec28-4251-ab90-b00d9b1ab349 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:05.268867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c030-ec28-4251-ab90-b00d9b1ab349 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:05.269143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c030-ec28-4251-ab90-b00d9b1ab349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:05.269915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363c030-ec28-4251-ab90-b00d9b1ab349 None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad, user.id=ff587d68b0de4327bd4c0d90116b3380) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:05.270225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363c030-ec28-4251-ab90-b00d9b1ab349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:05.271952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363c030-ec28-4251-ab90-b00d9b1ab349 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:05.288856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 46/94] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:04 2022] GET /identity/v3/role_assignments?user.id=ff587d68b0de4327bd4c0d90116b3380&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=28beda93f70d4c549352145ddee01aac => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:05.335195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6f841-010b-421b-a865-2c924327028c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:05.336704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6f841-010b-421b-a865-2c924327028c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:05.409787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:05.481300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 49/95] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:05:05.487214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363c030-ec28-4251-ab90-b00d9b1ab349 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:05.617113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363c030-ec28-4251-ab90-b00d9b1ab349 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:05.652009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839ff60-31b2-4fd2-802c-aada92818418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:05.652652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ff60-31b2-4fd2-802c-aada92818418 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:05.652935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ff60-31b2-4fd2-802c-aada92818418 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:05.653209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ff60-31b2-4fd2-802c-aada92818418 None admin] PATH_INFO: `/v3/projects/0e772e96b4af4dd1baba525f6d422807` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:05.654499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839ff60-31b2-4fd2-802c-aada92818418 None admin] RBAC: Authorizing `identity:get_project(project_id=0e772e96b4af4dd1baba525f6d422807)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:05.655992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839ff60-31b2-4fd2-802c-aada92818418 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:05.657685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 47/96] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:05 2022] GET /identity/v3/projects/0e772e96b4af4dd1baba525f6d422807 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:05.663797 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f841-010b-421b-a865-2c924327028c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:05.806044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f841-010b-421b-a865-2c924327028c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:05.855023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac27aa8-b470-48ee-bdd8-7f6a95aa8255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:05.855645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac27aa8-b470-48ee-bdd8-7f6a95aa8255 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:05.855924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac27aa8-b470-48ee-bdd8-7f6a95aa8255 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:05.856198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac27aa8-b470-48ee-bdd8-7f6a95aa8255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:05.857551 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac27aa8-b470-48ee-bdd8-7f6a95aa8255 None admin] RBAC: Adding query filter params (role.id=a64cd92139fb4f1fb64f05f5a88f999f, scope.project.id=0e772e96b4af4dd1baba525f6d422807, user.id=7d8d47bc48854f978d82fae1c6ad4c94) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:05.857979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac27aa8-b470-48ee-bdd8-7f6a95aa8255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:05.859445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac27aa8-b470-48ee-bdd8-7f6a95aa8255 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:05.866607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 50/97] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:05 2022] GET /identity/v3/role_assignments?user.id=7d8d47bc48854f978d82fae1c6ad4c94&scope.project.id=0e772e96b4af4dd1baba525f6d422807&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:07.618476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf444a0-9184-4ddc-8c32-2baad7247a11 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:07.619377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf444a0-9184-4ddc-8c32-2baad7247a11 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:07.619797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf444a0-9184-4ddc-8c32-2baad7247a11 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:07.621298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 48/98] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:07.626628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f51e7-5b5f-436e-a7d1-a211f6ad6bab None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:07.627394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f51e7-5b5f-436e-a7d1-a211f6ad6bab None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:07.627837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f51e7-5b5f-436e-a7d1-a211f6ad6bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:07.658406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2f0f51e7-5b5f-436e-a7d1-a211f6ad6bab None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:07.659859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2f0f51e7-5b5f-436e-a7d1-a211f6ad6bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:07.668314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:07.671481 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3af3-0c7b-4103-9bb1-b8c494e0fb68 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:07.671956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3af3-0c7b-4103-9bb1-b8c494e0fb68 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:07.672371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3af3-0c7b-4103-9bb1-b8c494e0fb68 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:07.673897 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 49/99] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:07.679102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9587-8b32-40f7-9afb-f1b997f280a9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:07.679554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9587-8b32-40f7-9afb-f1b997f280a9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:07.679972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b9587-8b32-40f7-9afb-f1b997f280a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:07.707425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0f1b9587-8b32-40f7-9afb-f1b997f280a9 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:07.711736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0f1b9587-8b32-40f7-9afb-f1b997f280a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:07.745713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:07.819869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 51/100] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:07.821107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071fb04-4b60-4e09-a250-16cf516e87d6 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:07.821416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071fb04-4b60-4e09-a250-16cf516e87d6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:07.821693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071fb04-4b60-4e09-a250-16cf516e87d6 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:07.823493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 52/101] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:07.830195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc7b2-16ec-46fa-8c1c-b809ffba01ee None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:07.830652 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc7b2-16ec-46fa-8c1c-b809ffba01ee None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:07.830972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc7b2-16ec-46fa-8c1c-b809ffba01ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:07.863580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 50/102] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:07.865070 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9cecc7b2-16ec-46fa-8c1c-b809ffba01ee None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:07.866471 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9cecc7b2-16ec-46fa-8c1c-b809ffba01ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:07.979681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 53/103] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:07.980314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6013da-11fe-4989-812d-baeb0b633f42 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:07.980606 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6013da-11fe-4989-812d-baeb0b633f42 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:07.980882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6013da-11fe-4989-812d-baeb0b633f42 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:07.982400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 51/104] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:05:07.991087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c26f-b59d-4948-8def-ce4f4882a05f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:07.991382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c26f-b59d-4948-8def-ce4f4882a05f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:07.991668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c26f-b59d-4948-8def-ce4f4882a05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:08.059432 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4378c26f-b59d-4948-8def-ce4f4882a05f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:08.061104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4378c26f-b59d-4948-8def-ce4f4882a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:08.155912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 54/105] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:08.165527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6013da-11fe-4989-812d-baeb0b633f42 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:08.278024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378c26f-b59d-4948-8def-ce4f4882a05f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:08.283304 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:08.327111 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6013da-11fe-4989-812d-baeb0b633f42 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:08.396571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e13b4e-6675-434d-bb9f-9b14c4b0d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:08.398125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13b4e-6675-434d-bb9f-9b14c4b0d8ef None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:08.398607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13b4e-6675-434d-bb9f-9b14c4b0d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:08.399033 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13b4e-6675-434d-bb9f-9b14c4b0d8ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:08.411420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e13b4e-6675-434d-bb9f-9b14c4b0d8ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-25e13b4e-6675-434d-bb9f-9b14c4b0d8ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:08.416437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:08.417494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:08.418248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:08.421275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 52/106] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:08.422838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d007c-fdcb-4d10-ba92-09a59e54054b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:08.423330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d007c-fdcb-4d10-ba92-09a59e54054b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:08.423806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d007c-fdcb-4d10-ba92-09a59e54054b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:08.426571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 53/107] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:08.427520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d007c-fdcb-4d10-ba92-09a59e54054b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:08.441676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:08.448994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378c26f-b59d-4948-8def-ce4f4882a05f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:08.494810 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c9d2d-b0c8-4b95-b040-28e01faf27d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:08.495455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9d2d-b0c8-4b95-b040-28e01faf27d3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:08.495728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9d2d-b0c8-4b95-b040-28e01faf27d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:08.496019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9d2d-b0c8-4b95-b040-28e01faf27d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:08.509279 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c9d2d-b0c8-4b95-b040-28e01faf27d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-e13c9d2d-b0c8-4b95-b040-28e01faf27d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:08.515095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:08.515980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:08.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 55/108] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:08.517387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c9d2d-b0c8-4b95-b040-28e01faf27d3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:08.547981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d007c-fdcb-4d10-ba92-09a59e54054b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:08.586496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0e3c9-078a-477f-8eef-487abbd7ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:08.587036 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:08.587432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e3c9-078a-477f-8eef-487abbd7ab02 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:08.587719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e3c9-078a-477f-8eef-487abbd7ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:08.587995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e3c9-078a-477f-8eef-487abbd7ab02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:08.589316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0e3c9-078a-477f-8eef-487abbd7ab02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:08.590847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0e3c9-078a-477f-8eef-487abbd7ab02 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:08.593396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 54/109] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:08.594140 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d358386-1045-449c-bc7b-1ad2836c2148 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:08.594476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d358386-1045-449c-bc7b-1ad2836c2148 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:08.594703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d358386-1045-449c-bc7b-1ad2836c2148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:08.613399 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7d358386-1045-449c-bc7b-1ad2836c2148 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:08.614620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7d358386-1045-449c-bc7b-1ad2836c2148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:08.636634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c9d2d-b0c8-4b95-b040-28e01faf27d3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:08.673196 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ac251-5907-4c57-9774-06690c569662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:08.673769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ac251-5907-4c57-9774-06690c569662 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:08.674052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ac251-5907-4c57-9774-06690c569662 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:08.674325 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ac251-5907-4c57-9774-06690c569662 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:08.675020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ac251-5907-4c57-9774-06690c569662 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:08.675298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ac251-5907-4c57-9774-06690c569662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:08.676680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ac251-5907-4c57-9774-06690c569662 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:08.684962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 56/110] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:08.686147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ac251-5907-4c57-9774-06690c569662 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:08.691110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 55/111] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:08.692554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d358386-1045-449c-bc7b-1ad2836c2148 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:08.702626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:08.807280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d358386-1045-449c-bc7b-1ad2836c2148 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:08.812322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ac251-5907-4c57-9774-06690c569662 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:08.838512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:08.847802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d08ad-b59a-4b1e-8c32-7966aa7d5956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:08.848460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d08ad-b59a-4b1e-8c32-7966aa7d5956 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:08.848740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d08ad-b59a-4b1e-8c32-7966aa7d5956 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:08.849008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d08ad-b59a-4b1e-8c32-7966aa7d5956 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:08.852114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb1a36-3ebf-4e5b-9aa4-b4014446b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:08.852114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1a36-3ebf-4e5b-9aa4-b4014446b93a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:08.852114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1a36-3ebf-4e5b-9aa4-b4014446b93a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:08.852329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1a36-3ebf-4e5b-9aa4-b4014446b93a None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:08.852864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb1a36-3ebf-4e5b-9aa4-b4014446b93a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:08.853170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb1a36-3ebf-4e5b-9aa4-b4014446b93a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:08.854600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb1a36-3ebf-4e5b-9aa4-b4014446b93a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:08.859904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d08ad-b59a-4b1e-8c32-7966aa7d5956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-705d08ad-b59a-4b1e-8c32-7966aa7d5956 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:08.864587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:08.866270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:08.867319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:08.867895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 57/112] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:08.867964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 56/113] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:08.867964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d08ad-b59a-4b1e-8c32-7966aa7d5956 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:08.873532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb1a36-3ebf-4e5b-9aa4-b4014446b93a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:08.942968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:08.980110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d08ad-b59a-4b1e-8c32-7966aa7d5956 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:08.980759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb1a36-3ebf-4e5b-9aa4-b4014446b93a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:09.014851 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13f9c3-bae7-4fc0-ba2e-30cda269df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:09.015346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd7a87-d593-4807-8133-0eb164f32091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:09.015500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13f9c3-bae7-4fc0-ba2e-30cda269df9e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.015777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13f9c3-bae7-4fc0-ba2e-30cda269df9e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.015961 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd7a87-d593-4807-8133-0eb164f32091 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.016049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13f9c3-bae7-4fc0-ba2e-30cda269df9e None admin] PATH_INFO: `/v3/users/da62ae5d32124852b1a3bd0b425bcf54` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.016245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd7a87-d593-4807-8133-0eb164f32091 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.016519 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd7a87-d593-4807-8133-0eb164f32091 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.017161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd7a87-d593-4807-8133-0eb164f32091 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:09.018661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd7a87-d593-4807-8133-0eb164f32091 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:09.029024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13f9c3-bae7-4fc0-ba2e-30cda269df9e None admin] RBAC: Authorizing `identity:get_user(user_id=da62ae5d32124852b1a3bd0b425bcf54)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:09.030640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13f9c3-bae7-4fc0-ba2e-30cda269df9e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:09.032250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 57/114] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:08 2022] GET /identity/v3/users/da62ae5d32124852b1a3bd0b425bcf54 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:09.033406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970271b-cbcb-41bb-8f23-58cca942ab0c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.033686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970271b-cbcb-41bb-8f23-58cca942ab0c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.033957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970271b-cbcb-41bb-8f23-58cca942ab0c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.035151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 58/115] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:09.037499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970271b-cbcb-41bb-8f23-58cca942ab0c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:09.121394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 58/116] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:05:08 2022] POST /identity/v3/projects => generated 302 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:09.121394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd7a87-d593-4807-8133-0eb164f32091 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:09.141671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970271b-cbcb-41bb-8f23-58cca942ab0c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:09.155207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:09.172056 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:09.183279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9859f8c-1154-468c-827b-3cba67311168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:09.183943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9859f8c-1154-468c-827b-3cba67311168 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.184231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9859f8c-1154-468c-827b-3cba67311168 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.184505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9859f8c-1154-468c-827b-3cba67311168 None admin] PATH_INFO: `/v3/users/7d8d47bc48854f978d82fae1c6ad4c94` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.186049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9859f8c-1154-468c-827b-3cba67311168 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8d47bc48854f978d82fae1c6ad4c94)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:09.187668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9859f8c-1154-468c-827b-3cba67311168 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:09.189426 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 59/117] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:09 2022] GET /identity/v3/users/7d8d47bc48854f978d82fae1c6ad4c94 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:09.190298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9859f8c-1154-468c-827b-3cba67311168 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:09.227048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd7a87-d593-4807-8133-0eb164f32091 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:09.267561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb805949-6d7b-4a46-b335-49534cb7bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:09.268179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb805949-6d7b-4a46-b335-49534cb7bbef None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.268462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb805949-6d7b-4a46-b335-49534cb7bbef None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.268795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb805949-6d7b-4a46-b335-49534cb7bbef None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.269465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb805949-6d7b-4a46-b335-49534cb7bbef None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:09.270497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb805949-6d7b-4a46-b335-49534cb7bbef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:09.271138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb805949-6d7b-4a46-b335-49534cb7bbef None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:09.283155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 59/118] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:09.283155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb805949-6d7b-4a46-b335-49534cb7bbef None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:09.308860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9859f8c-1154-468c-827b-3cba67311168 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:09.348388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010d488-bcd7-4d63-bd7b-e3bf11ac08f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:09.349026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010d488-bcd7-4d63-bd7b-e3bf11ac08f1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.349315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010d488-bcd7-4d63-bd7b-e3bf11ac08f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.349616 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010d488-bcd7-4d63-bd7b-e3bf11ac08f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.360114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010d488-bcd7-4d63-bd7b-e3bf11ac08f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6010d488-bcd7-4d63-bd7b-e3bf11ac08f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:09.365329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:09.366295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:09.367044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 60/119] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:09.367673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f36c9-1974-42de-b412-9162c6e68f21 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.368579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f36c9-1974-42de-b412-9162c6e68f21 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.368579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f36c9-1974-42de-b412-9162c6e68f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.385918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ea6f36c9-1974-42de-b412-9162c6e68f21 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:09.387112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ea6f36c9-1974-42de-b412-9162c6e68f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:09.396423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:09.399489 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb805949-6d7b-4a46-b335-49534cb7bbef None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:09.436007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723c95e-a76e-4fbb-9332-a673175aee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:09.436634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723c95e-a76e-4fbb-9332-a673175aee0c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.436919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723c95e-a76e-4fbb-9332-a673175aee0c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.437578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723c95e-a76e-4fbb-9332-a673175aee0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.438397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:09.459393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 61/120] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:09.460173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f36c9-1974-42de-b412-9162c6e68f21 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:09.525905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723c95e-a76e-4fbb-9332-a673175aee0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:09.527925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723c95e-a76e-4fbb-9332-a673175aee0c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:09.574454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f36c9-1974-42de-b412-9162c6e68f21 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:09.625066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc35fd0-4886-422e-a816-a335717453d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:09.625783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc35fd0-4886-422e-a816-a335717453d5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.626068 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc35fd0-4886-422e-a816-a335717453d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.626345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc35fd0-4886-422e-a816-a335717453d5 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.627496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc35fd0-4886-422e-a816-a335717453d5 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:09.629562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc35fd0-4886-422e-a816-a335717453d5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:09.632005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 62/121] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:09 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:09.633028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc35fd0-4886-422e-a816-a335717453d5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:09.640265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:09.644744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 60/122] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:09.645832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723c95e-a76e-4fbb-9332-a673175aee0c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:09.702488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:09.754272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723c95e-a76e-4fbb-9332-a673175aee0c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:09.762303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc35fd0-4886-422e-a816-a335717453d5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:09.798337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547823ff-6dbd-4a49-8869-bedb90888ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:09.798867 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547823ff-6dbd-4a49-8869-bedb90888ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.799147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547823ff-6dbd-4a49-8869-bedb90888ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.799389 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3518f8-0075-4496-875b-23277aee50b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:09.799507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547823ff-6dbd-4a49-8869-bedb90888ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.800063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547823ff-6dbd-4a49-8869-bedb90888ad5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:09.800287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3518f8-0075-4496-875b-23277aee50b2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.800373 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547823ff-6dbd-4a49-8869-bedb90888ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:09.800718 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3518f8-0075-4496-875b-23277aee50b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.801082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3518f8-0075-4496-875b-23277aee50b2 None admin] PATH_INFO: `/v3/users/7d8d47bc48854f978d82fae1c6ad4c94` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.801767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547823ff-6dbd-4a49-8869-bedb90888ad5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:09.802425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3518f8-0075-4496-875b-23277aee50b2 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8d47bc48854f978d82fae1c6ad4c94)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:09.803964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3518f8-0075-4496-875b-23277aee50b2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:09.805681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 63/123] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:09 2022] GET /identity/v3/users/7d8d47bc48854f978d82fae1c6ad4c94 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:09.806503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3518f8-0075-4496-875b-23277aee50b2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:09.815246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 61/124] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:09.815597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547823ff-6dbd-4a49-8869-bedb90888ad5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:09.879216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:09.925722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3518f8-0075-4496-875b-23277aee50b2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:09.926033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547823ff-6dbd-4a49-8869-bedb90888ad5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:09.947182 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:09.960643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187bc0-2d98-4542-974c-00cd2e7cc206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:09.961548 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187bc0-2d98-4542-974c-00cd2e7cc206 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.961829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187bc0-2d98-4542-974c-00cd2e7cc206 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.962104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187bc0-2d98-4542-974c-00cd2e7cc206 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.963292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80187bc0-2d98-4542-974c-00cd2e7cc206 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:09.964740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80187bc0-2d98-4542-974c-00cd2e7cc206 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:09.967171 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 62/125] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:09 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:09.968052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187bc0-2d98-4542-974c-00cd2e7cc206 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:09.972729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116d734-1183-4cf2-9f56-5121e504908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:09.973302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116d734-1183-4cf2-9f56-5121e504908d None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:09.973604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116d734-1183-4cf2-9f56-5121e504908d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:09.973881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116d734-1183-4cf2-9f56-5121e504908d None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/users/7d8d47bc48854f978d82fae1c6ad4c94/roles/68da777efbc34e15a79e851577a8ee89` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:09.976102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116d734-1183-4cf2-9f56-5121e504908d None admin] RBAC: Authorizing `identity:create_grant(project_id=9f6f6d4571bf4ceeb09359528c51bbad, user_id=7d8d47bc48854f978d82fae1c6ad4c94, role_id=68da777efbc34e15a79e851577a8ee89)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:09.977745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116d734-1183-4cf2-9f56-5121e504908d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:10.072060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 64/126] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:05:09 2022] PUT /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/users/7d8d47bc48854f978d82fae1c6ad4c94/roles/68da777efbc34e15a79e851577a8ee89 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:10.072811 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116d734-1183-4cf2-9f56-5121e504908d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:10.087199 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80187bc0-2d98-4542-974c-00cd2e7cc206 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:10.127210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:10.135096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c4777-8cc4-4aa7-8930-94b9e41f1be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:10.136020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c4777-8cc4-4aa7-8930-94b9e41f1be0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:10.136302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c4777-8cc4-4aa7-8930-94b9e41f1be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:10.136585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c4777-8cc4-4aa7-8930-94b9e41f1be0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:10.154464 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c4777-8cc4-4aa7-8930-94b9e41f1be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-fa8c4777-8cc4-4aa7-8930-94b9e41f1be0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:10.161020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:10.162154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:10.163189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:10.171863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 63/127] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:10.172834 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c4777-8cc4-4aa7-8930-94b9e41f1be0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:10.208785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116d734-1183-4cf2-9f56-5121e504908d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:10.257774 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd991-0b68-47c3-b85f-f9f83c7e20f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:10.259044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd991-0b68-47c3-b85f-f9f83c7e20f6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:10.259044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd991-0b68-47c3-b85f-f9f83c7e20f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:10.259044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd991-0b68-47c3-b85f-f9f83c7e20f6 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:10.260194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acd991-0b68-47c3-b85f-f9f83c7e20f6 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:10.261706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acd991-0b68-47c3-b85f-f9f83c7e20f6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:10.263973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 65/128] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:10 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:10.265111 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd991-0b68-47c3-b85f-f9f83c7e20f6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:10.313591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c4777-8cc4-4aa7-8930-94b9e41f1be0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:10.320820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:10.355921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030a114-f1d9-43de-a280-8db027e1057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:10.356883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030a114-f1d9-43de-a280-8db027e1057e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:10.357205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030a114-f1d9-43de-a280-8db027e1057e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:10.357554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030a114-f1d9-43de-a280-8db027e1057e None admin] PATH_INFO: `/v3/users/ff587d68b0de4327bd4c0d90116b3380` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:10.359574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030a114-f1d9-43de-a280-8db027e1057e None admin] RBAC: Authorizing `identity:get_user(user_id=ff587d68b0de4327bd4c0d90116b3380)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:10.361175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030a114-f1d9-43de-a280-8db027e1057e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:10.362972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 64/129] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:10 2022] GET /identity/v3/users/ff587d68b0de4327bd4c0d90116b3380 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:10.364083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030a114-f1d9-43de-a280-8db027e1057e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:10.375607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd991-0b68-47c3-b85f-f9f83c7e20f6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:10.413048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e2210-f515-40e6-8fd5-fb81551945d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:10.413686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e2210-f515-40e6-8fd5-fb81551945d8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:10.413964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e2210-f515-40e6-8fd5-fb81551945d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:10.414236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e2210-f515-40e6-8fd5-fb81551945d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:10.414965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e2210-f515-40e6-8fd5-fb81551945d8 None admin] RBAC: Adding query filter params (role.id=fca599016d83441ab8908df85d7fcbbd, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad, user.id=da62ae5d32124852b1a3bd0b425bcf54) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:10.415266 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e2210-f515-40e6-8fd5-fb81551945d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:10.416743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e2210-f515-40e6-8fd5-fb81551945d8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:10.422886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 66/130] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:10 2022] GET /identity/v3/role_assignments?user.id=da62ae5d32124852b1a3bd0b425bcf54&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=fca599016d83441ab8908df85d7fcbbd => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:10.423757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e2210-f515-40e6-8fd5-fb81551945d8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:10.439484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:10.563101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e2210-f515-40e6-8fd5-fb81551945d8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:10.571479 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030a114-f1d9-43de-a280-8db027e1057e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:10.577758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:10.604395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181fb01-3c7f-4105-bd82-1c0b182977c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:10.605329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181fb01-3c7f-4105-bd82-1c0b182977c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:10.605772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181fb01-3c7f-4105-bd82-1c0b182977c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:10.606238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181fb01-3c7f-4105-bd82-1c0b182977c9 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/users/7d8d47bc48854f978d82fae1c6ad4c94/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:10.609787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181fb01-3c7f-4105-bd82-1c0b182977c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f6f6d4571bf4ceeb09359528c51bbad, user_id=7d8d47bc48854f978d82fae1c6ad4c94, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:10.611547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181fb01-3c7f-4105-bd82-1c0b182977c9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:10.637622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabbaa5-d820-435d-9c76-8d85c63da9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:10.639102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabbaa5-d820-435d-9c76-8d85c63da9bf None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:10.639443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabbaa5-d820-435d-9c76-8d85c63da9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:10.639724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabbaa5-d820-435d-9c76-8d85c63da9bf None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:10.640398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabbaa5-d820-435d-9c76-8d85c63da9bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:10.640934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabbaa5-d820-435d-9c76-8d85c63da9bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:10.642289 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabbaa5-d820-435d-9c76-8d85c63da9bf None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:10.651840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 65/131] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:10.652536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabbaa5-d820-435d-9c76-8d85c63da9bf None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:10.715606 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 67/132] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:05:10 2022] PUT /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/users/7d8d47bc48854f978d82fae1c6ad4c94/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:10.717479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181fb01-3c7f-4105-bd82-1c0b182977c9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:10.777759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabbaa5-d820-435d-9c76-8d85c63da9bf None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:10.802236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:10.820522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c98e1b-e054-49ef-a26b-3acc16006a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:10.821218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c98e1b-e054-49ef-a26b-3acc16006a28 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:10.821527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c98e1b-e054-49ef-a26b-3acc16006a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:10.821804 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c98e1b-e054-49ef-a26b-3acc16006a28 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:10.823565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c98e1b-e054-49ef-a26b-3acc16006a28 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:10.825192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c98e1b-e054-49ef-a26b-3acc16006a28 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:10.827910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 66/133] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:10 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:10.834149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c98e1b-e054-49ef-a26b-3acc16006a28 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:10.950113 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c98e1b-e054-49ef-a26b-3acc16006a28 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:11.000449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274a7e4-df09-493d-88e1-a927f50c49ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:11.001144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274a7e4-df09-493d-88e1-a927f50c49ee None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:11.001458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274a7e4-df09-493d-88e1-a927f50c49ee None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:11.001737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274a7e4-df09-493d-88e1-a927f50c49ee None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/users/ff587d68b0de4327bd4c0d90116b3380/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:11.004078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274a7e4-df09-493d-88e1-a927f50c49ee None admin] RBAC: Authorizing `identity:create_grant(project_id=9f6f6d4571bf4ceeb09359528c51bbad, user_id=ff587d68b0de4327bd4c0d90116b3380, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:11.005604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274a7e4-df09-493d-88e1-a927f50c49ee None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:11.042625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181fb01-3c7f-4105-bd82-1c0b182977c9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:11.081298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f0ced-002c-4454-95b7-e96802f66865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:11.082053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f0ced-002c-4454-95b7-e96802f66865 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:11.084339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f0ced-002c-4454-95b7-e96802f66865 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:11.086160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f0ced-002c-4454-95b7-e96802f66865 None admin] PATH_INFO: `/v3/users/7d8d47bc48854f978d82fae1c6ad4c94` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:11.089129 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 67/134] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:05:10 2022] PUT /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/users/ff587d68b0de4327bd4c0d90116b3380/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:05:11.092932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f0ced-002c-4454-95b7-e96802f66865 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8d47bc48854f978d82fae1c6ad4c94)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:11.094508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f0ced-002c-4454-95b7-e96802f66865 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:11.096409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 68/135] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:10 2022] GET /identity/v3/users/7d8d47bc48854f978d82fae1c6ad4c94 => generated 275 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:11.104378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274a7e4-df09-493d-88e1-a927f50c49ee None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:11.166054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:11.228252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274a7e4-df09-493d-88e1-a927f50c49ee None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:11.270276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8990b-d72b-4b3a-994f-8246adc7626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:11.271006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8990b-d72b-4b3a-994f-8246adc7626b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:11.271288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8990b-d72b-4b3a-994f-8246adc7626b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:11.271560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8990b-d72b-4b3a-994f-8246adc7626b None admin] PATH_INFO: `/v3/projects/0e772e96b4af4dd1baba525f6d422807` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:11.273808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a261ef-b956-446c-b2c3-500175baac5d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:11.274089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a261ef-b956-446c-b2c3-500175baac5d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:11.274362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a261ef-b956-446c-b2c3-500175baac5d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:11.275710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 69/136] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:05:11.276226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8990b-d72b-4b3a-994f-8246adc7626b None admin] RBAC: Authorizing `identity:get_project(project_id=0e772e96b4af4dd1baba525f6d422807)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:11.277828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8990b-d72b-4b3a-994f-8246adc7626b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:11.280078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 68/137] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:11 2022] GET /identity/v3/projects/0e772e96b4af4dd1baba525f6d422807 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:11.281928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef9d6c-22b5-41c0-8ee4-4d44e0940ecf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:11.282221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef9d6c-22b5-41c0-8ee4-4d44e0940ecf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:11.282503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef9d6c-22b5-41c0-8ee4-4d44e0940ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:11.286300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8990b-d72b-4b3a-994f-8246adc7626b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:11.315688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ceef9d6c-22b5-41c0-8ee4-4d44e0940ecf None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:11.316908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ceef9d6c-22b5-41c0-8ee4-4d44e0940ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:11.381868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:11.445022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 70/138] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:11.482342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8990b-d72b-4b3a-994f-8246adc7626b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:11.507615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:11.536546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fa829-f746-49d7-985f-0d26e9da4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:11.537228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fa829-f746-49d7-985f-0d26e9da4b8b None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:11.537542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fa829-f746-49d7-985f-0d26e9da4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:11.537826 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fa829-f746-49d7-985f-0d26e9da4b8b None admin] PATH_INFO: `/v3/projects/0e772e96b4af4dd1baba525f6d422807/users/7d8d47bc48854f978d82fae1c6ad4c94/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:11.542711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fa829-f746-49d7-985f-0d26e9da4b8b None admin] RBAC: Authorizing `identity:create_grant(project_id=0e772e96b4af4dd1baba525f6d422807, user_id=7d8d47bc48854f978d82fae1c6ad4c94, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:11.544863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fa829-f746-49d7-985f-0d26e9da4b8b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:11.615572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 69/139] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:05:11 2022] PUT /identity/v3/projects/0e772e96b4af4dd1baba525f6d422807/users/7d8d47bc48854f978d82fae1c6ad4c94/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:05:11.925922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef9d6c-22b5-41c0-8ee4-4d44e0940ecf None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:12.036905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef9d6c-22b5-41c0-8ee4-4d44e0940ecf None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:12.084696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c5de6-ed93-41ee-a297-14bfbd8d7dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:12.085342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c5de6-ed93-41ee-a297-14bfbd8d7dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:12.085648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c5de6-ed93-41ee-a297-14bfbd8d7dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:12.085922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c5de6-ed93-41ee-a297-14bfbd8d7dd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:12.090047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c5de6-ed93-41ee-a297-14bfbd8d7dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:12.091588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c5de6-ed93-41ee-a297-14bfbd8d7dd9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:12.093196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 71/140] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:12.098898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fa829-f746-49d7-985f-0d26e9da4b8b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:12.233003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fa829-f746-49d7-985f-0d26e9da4b8b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:12.278041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f69338-7302-4830-96d3-ccb34d064e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:12.278748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f69338-7302-4830-96d3-ccb34d064e27 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:12.279029 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f69338-7302-4830-96d3-ccb34d064e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:12.279308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f69338-7302-4830-96d3-ccb34d064e27 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:12.280007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f69338-7302-4830-96d3-ccb34d064e27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:12.281479 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f69338-7302-4830-96d3-ccb34d064e27 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:12.404386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 70/141] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:12 2022] POST /identity/v3/users => generated 283 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:12.451374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa119-9cd1-46dd-801b-b710f9873780 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:12.451752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa119-9cd1-46dd-801b-b710f9873780 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:12.452032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa119-9cd1-46dd-801b-b710f9873780 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:12.453759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 72/142] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:12.459388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d727258-20c2-41fc-8d97-acfd834e8ea2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:12.459685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d727258-20c2-41fc-8d97-acfd834e8ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:12.460168 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d727258-20c2-41fc-8d97-acfd834e8ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:12.485205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4d727258-20c2-41fc-8d97-acfd834e8ea2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:12.486424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4d727258-20c2-41fc-8d97-acfd834e8ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:12.526283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:12.588392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 71/143] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:12.999340 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa119-9cd1-46dd-801b-b710f9873780 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:13.048368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:13.075327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b7084-c1ba-4c22-9f76-eb6af22ebd10 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:13.076275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b7084-c1ba-4c22-9f76-eb6af22ebd10 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:13.076557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b7084-c1ba-4c22-9f76-eb6af22ebd10 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:13.078318 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 72/144] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:13.091151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0258c-8e30-40ee-8e39-17698814abd5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:13.091613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0258c-8e30-40ee-8e39-17698814abd5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:13.092099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0258c-8e30-40ee-8e39-17698814abd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:13.126811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-60b0258c-8e30-40ee-8e39-17698814abd5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:13.128033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-60b0258c-8e30-40ee-8e39-17698814abd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:13.146119 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa119-9cd1-46dd-801b-b710f9873780 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:13.203577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0839fe-f1f5-4e86-ada4-9b97574ed2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:13.205518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0839fe-f1f5-4e86-ada4-9b97574ed2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:13.205807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0839fe-f1f5-4e86-ada4-9b97574ed2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:13.206980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0839fe-f1f5-4e86-ada4-9b97574ed2a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:13.227535 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0839fe-f1f5-4e86-ada4-9b97574ed2a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7c0839fe-f1f5-4e86-ada4-9b97574ed2a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:13.237668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:13.238527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:13.239275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 73/145] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:13.245766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 73/146] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:13.253515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0839fe-f1f5-4e86-ada4-9b97574ed2a0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:13.361094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:13.366997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0839fe-f1f5-4e86-ada4-9b97574ed2a0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:13.406103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3627-b91b-4cec-85cb-a7b44d51a84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:13.406731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3627-b91b-4cec-85cb-a7b44d51a84e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:13.407012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3627-b91b-4cec-85cb-a7b44d51a84e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:13.407287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3627-b91b-4cec-85cb-a7b44d51a84e None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:13.407966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3627-b91b-4cec-85cb-a7b44d51a84e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:13.408271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3627-b91b-4cec-85cb-a7b44d51a84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:13.409719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3627-b91b-4cec-85cb-a7b44d51a84e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:13.418386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 74/147] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:13.425186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0258c-8e30-40ee-8e39-17698814abd5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:13.532061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:13.541393 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0258c-8e30-40ee-8e39-17698814abd5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:13.580018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39b63e-3c8e-448b-8c03-85a0edac15c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:13.580669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39b63e-3c8e-448b-8c03-85a0edac15c8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:13.581018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39b63e-3c8e-448b-8c03-85a0edac15c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:13.581295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39b63e-3c8e-448b-8c03-85a0edac15c8 None admin] PATH_INFO: `/v3/users/7d8d47bc48854f978d82fae1c6ad4c94` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:13.582515 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39b63e-3c8e-448b-8c03-85a0edac15c8 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8d47bc48854f978d82fae1c6ad4c94)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:13.584098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39b63e-3c8e-448b-8c03-85a0edac15c8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:13.585721 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 74/148] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:13 2022] GET /identity/v3/users/7d8d47bc48854f978d82fae1c6ad4c94 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:13.592650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3627-b91b-4cec-85cb-a7b44d51a84e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:13.715716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3627-b91b-4cec-85cb-a7b44d51a84e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:13.760325 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f53ad7-212a-4963-b970-9c003d09e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:13.760940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53ad7-212a-4963-b970-9c003d09e719 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:13.761218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53ad7-212a-4963-b970-9c003d09e719 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:13.761518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53ad7-212a-4963-b970-9c003d09e719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:13.796527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:13.834868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39b63e-3c8e-448b-8c03-85a0edac15c8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:13.850117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f53ad7-212a-4963-b970-9c003d09e719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:13.851805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f53ad7-212a-4963-b970-9c003d09e719 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:13.978130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39b63e-3c8e-448b-8c03-85a0edac15c8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:14.024245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77631701-5697-44c6-ad0f-630cd54dd7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:14.024932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631701-5697-44c6-ad0f-630cd54dd7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:14.025211 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631701-5697-44c6-ad0f-630cd54dd7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:14.025538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631701-5697-44c6-ad0f-630cd54dd7f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:14.039868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 75/149] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:14.041911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482635b0-c9c3-4c37-9af9-7870cfbe82f8 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:14.045569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482635b0-c9c3-4c37-9af9-7870cfbe82f8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:14.046008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482635b0-c9c3-4c37-9af9-7870cfbe82f8 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:14.047563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 76/150] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:14.051186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482635b0-c9c3-4c37-9af9-7870cfbe82f8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:14.053056 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77631701-5697-44c6-ad0f-630cd54dd7f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-77631701-5697-44c6-ad0f-630cd54dd7f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:14.062882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:14.070365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 75/151] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:14.071119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12595e-7601-4068-9755-0c92974d4218 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:14.071842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12595e-7601-4068-9755-0c92974d4218 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:14.071842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12595e-7601-4068-9755-0c92974d4218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:14.089738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-dc12595e-7601-4068-9755-0c92974d4218 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:14.091188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-dc12595e-7601-4068-9755-0c92974d4218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:14.108565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:14.141495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:14.176436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 76/152] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:14.177877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12595e-7601-4068-9755-0c92974d4218 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:14.235069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482635b0-c9c3-4c37-9af9-7870cfbe82f8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:14.304798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112fcf-7ed0-4f99-b857-5b741d63fe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:14.305859 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112fcf-7ed0-4f99-b857-5b741d63fe2e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:14.308004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112fcf-7ed0-4f99-b857-5b741d63fe2e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:14.308440 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112fcf-7ed0-4f99-b857-5b741d63fe2e None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:14.310641 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93112fcf-7ed0-4f99-b857-5b741d63fe2e None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:14.313517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93112fcf-7ed0-4f99-b857-5b741d63fe2e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:14.316582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 77/153] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:14 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:14.320237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6136-8566-4cd0-985d-6eff9d5f7726 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:14.320689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6136-8566-4cd0-985d-6eff9d5f7726 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:14.322551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6136-8566-4cd0-985d-6eff9d5f7726 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:14.326858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 78/154] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:14.327955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6136-8566-4cd0-985d-6eff9d5f7726 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:14.379359 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12595e-7601-4068-9755-0c92974d4218 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:14.452141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e907b2c-b155-4fb6-b2ca-c3f99b6bb80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:14.453309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e907b2c-b155-4fb6-b2ca-c3f99b6bb80d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:14.454418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e907b2c-b155-4fb6-b2ca-c3f99b6bb80d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:14.455026 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e907b2c-b155-4fb6-b2ca-c3f99b6bb80d None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:14.456475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e907b2c-b155-4fb6-b2ca-c3f99b6bb80d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:14.457103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e907b2c-b155-4fb6-b2ca-c3f99b6bb80d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:14.459686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e907b2c-b155-4fb6-b2ca-c3f99b6bb80d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:14.478216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 77/155] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:14.483279 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd79a89-bcab-479d-a673-32fe53872392 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:14.485680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd79a89-bcab-479d-a673-32fe53872392 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:14.486127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd79a89-bcab-479d-a673-32fe53872392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:14.518274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1bd79a89-bcab-479d-a673-32fe53872392 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:14.519844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1bd79a89-bcab-479d-a673-32fe53872392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:14.537582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:14.541272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6136-8566-4cd0-985d-6eff9d5f7726 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:14.583274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:14.604041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ed717-73c7-4b04-8d9b-ea7ae7fa14f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:14.604655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ed717-73c7-4b04-8d9b-ea7ae7fa14f9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:14.604932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ed717-73c7-4b04-8d9b-ea7ae7fa14f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:14.605225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ed717-73c7-4b04-8d9b-ea7ae7fa14f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:14.605950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ed717-73c7-4b04-8d9b-ea7ae7fa14f9 None admin] RBAC: Adding query filter params (role.id=68da777efbc34e15a79e851577a8ee89, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad, user.id=7d8d47bc48854f978d82fae1c6ad4c94) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:14.606263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ed717-73c7-4b04-8d9b-ea7ae7fa14f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:14.608748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ed717-73c7-4b04-8d9b-ea7ae7fa14f9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:14.627908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 79/156] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:14 2022] GET /identity/v3/role_assignments?user.id=7d8d47bc48854f978d82fae1c6ad4c94&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=68da777efbc34e15a79e851577a8ee89 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:14.628826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ed717-73c7-4b04-8d9b-ea7ae7fa14f9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:14.707696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 78/157] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:14.752964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd79a89-bcab-479d-a673-32fe53872392 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:14.852564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ed717-73c7-4b04-8d9b-ea7ae7fa14f9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:14.941537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7da0cc-f4d3-4c1f-85c1-01ff4716aef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:14.942184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7da0cc-f4d3-4c1f-85c1-01ff4716aef8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:14.942464 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7da0cc-f4d3-4c1f-85c1-01ff4716aef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:14.942737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7da0cc-f4d3-4c1f-85c1-01ff4716aef8 None admin] PATH_INFO: `/v3/users/da62ae5d32124852b1a3bd0b425bcf54` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:14.943895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7da0cc-f4d3-4c1f-85c1-01ff4716aef8 None admin] RBAC: Authorizing `identity:get_user(user_id=da62ae5d32124852b1a3bd0b425bcf54)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:14.945393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7da0cc-f4d3-4c1f-85c1-01ff4716aef8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:14.953297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 80/158] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:14 2022] GET /identity/v3/users/da62ae5d32124852b1a3bd0b425bcf54 => generated 289 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:14.959119 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7da0cc-f4d3-4c1f-85c1-01ff4716aef8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:14.997304 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd79a89-bcab-479d-a673-32fe53872392 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:15.067976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb3d35-c315-464e-9985-9c2315897932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:15.068636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3d35-c315-464e-9985-9c2315897932 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:15.068913 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3d35-c315-464e-9985-9c2315897932 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:15.069184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3d35-c315-464e-9985-9c2315897932 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:15.087604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:15.096523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb3d35-c315-464e-9985-9c2315897932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b1fb3d35-c315-464e-9985-9c2315897932 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:15.101439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:15.105947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:15.107322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 79/159] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:15.111326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb3d35-c315-464e-9985-9c2315897932 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:15.115102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:15.177208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7da0cc-f4d3-4c1f-85c1-01ff4716aef8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:15.241271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ddff9-411e-472d-94b8-1f83977e84c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:15.241947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ddff9-411e-472d-94b8-1f83977e84c1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:15.242223 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ddff9-411e-472d-94b8-1f83977e84c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:15.242489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ddff9-411e-472d-94b8-1f83977e84c1 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:15.243749 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ddff9-411e-472d-94b8-1f83977e84c1 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:15.245198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ddff9-411e-472d-94b8-1f83977e84c1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:15.247519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 81/160] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:14 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:15.256147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ddff9-411e-472d-94b8-1f83977e84c1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:15.310690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb3d35-c315-464e-9985-9c2315897932 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:15.356559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdeae2-27da-4d58-be13-9df24fe11ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:15.357084 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdeae2-27da-4d58-be13-9df24fe11ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:15.357385 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdeae2-27da-4d58-be13-9df24fe11ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:15.357649 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdeae2-27da-4d58-be13-9df24fe11ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:15.358343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdeae2-27da-4d58-be13-9df24fe11ac9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:15.358640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdeae2-27da-4d58-be13-9df24fe11ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:15.360095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdeae2-27da-4d58-be13-9df24fe11ac9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:15.376573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 80/161] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:15.377450 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdeae2-27da-4d58-be13-9df24fe11ac9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:15.433200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ddff9-411e-472d-94b8-1f83977e84c1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:15.447250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:15.465611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:15.480470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c2750-2943-484e-ab5e-09a6f0a74aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:15.481530 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c2750-2943-484e-ab5e-09a6f0a74aa8 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:15.482124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c2750-2943-484e-ab5e-09a6f0a74aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:15.482581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c2750-2943-484e-ab5e-09a6f0a74aa8 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/users/da62ae5d32124852b1a3bd0b425bcf54/roles/fca599016d83441ab8908df85d7fcbbd` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:15.486831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c2750-2943-484e-ab5e-09a6f0a74aa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f6f6d4571bf4ceeb09359528c51bbad, user_id=da62ae5d32124852b1a3bd0b425bcf54, role_id=fca599016d83441ab8908df85d7fcbbd)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:15.488428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c2750-2943-484e-ab5e-09a6f0a74aa8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:15.488659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdeae2-27da-4d58-be13-9df24fe11ac9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:15.523222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d067e30-de96-4f65-a864-13103f8d4de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:15.523847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d067e30-de96-4f65-a864-13103f8d4de2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:15.524117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d067e30-de96-4f65-a864-13103f8d4de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:15.524378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d067e30-de96-4f65-a864-13103f8d4de2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:15.535614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d067e30-de96-4f65-a864-13103f8d4de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-7d067e30-de96-4f65-a864-13103f8d4de2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:15.540704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:15.541695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:15.542456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 81/162] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:15.543615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c91f7-4ea0-4278-9c44-542bb339e33a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:15.543615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c91f7-4ea0-4278-9c44-542bb339e33a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:15.543760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c91f7-4ea0-4278-9c44-542bb339e33a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:15.545152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 82/163] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:15.549635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c91f7-4ea0-4278-9c44-542bb339e33a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:15.573645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 82/164] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:05:15 2022] PUT /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/users/da62ae5d32124852b1a3bd0b425bcf54/roles/fca599016d83441ab8908df85d7fcbbd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:05:15.574773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c2750-2943-484e-ab5e-09a6f0a74aa8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:15.664462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c91f7-4ea0-4278-9c44-542bb339e33a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:15.690682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:15.704381 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7ec3b-8154-4430-ae71-110274079271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:15.705071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7ec3b-8154-4430-ae71-110274079271 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:15.705346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7ec3b-8154-4430-ae71-110274079271 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:15.705733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7ec3b-8154-4430-ae71-110274079271 None admin] PATH_INFO: `/v3/users/7d8d47bc48854f978d82fae1c6ad4c94` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:15.707159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7ec3b-8154-4430-ae71-110274079271 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8d47bc48854f978d82fae1c6ad4c94)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:15.708619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7ec3b-8154-4430-ae71-110274079271 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:15.710571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 83/165] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:15 2022] GET /identity/v3/users/7d8d47bc48854f978d82fae1c6ad4c94 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:15.711953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035828-928e-4523-9f4f-81b3d1d151e6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:15.712230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035828-928e-4523-9f4f-81b3d1d151e6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:15.712665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035828-928e-4523-9f4f-81b3d1d151e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:15.733040 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c1035828-928e-4523-9f4f-81b3d1d151e6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:15.734457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c1035828-928e-4523-9f4f-81b3d1d151e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:15.740945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c2750-2943-484e-ab5e-09a6f0a74aa8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:15.780621 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080578-b514-42b7-87e5-2c59465cd177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:15.781244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080578-b514-42b7-87e5-2c59465cd177 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:15.781582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080578-b514-42b7-87e5-2c59465cd177 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:15.781936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080578-b514-42b7-87e5-2c59465cd177 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:15.782617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1080578-b514-42b7-87e5-2c59465cd177 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:15.782919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1080578-b514-42b7-87e5-2c59465cd177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:15.784462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1080578-b514-42b7-87e5-2c59465cd177 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:15.795674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 83/166] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:15.796547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080578-b514-42b7-87e5-2c59465cd177 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:15.808560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 84/167] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:15.809296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1035828-928e-4523-9f4f-81b3d1d151e6 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:15.862307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:15.924172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080578-b514-42b7-87e5-2c59465cd177 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:15.984116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f16646-e7f5-468f-9279-fe470181817a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:15.984792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16646-e7f5-468f-9279-fe470181817a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:15.985075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16646-e7f5-468f-9279-fe470181817a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:15.985349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16646-e7f5-468f-9279-fe470181817a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:15.987429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1035828-928e-4523-9f4f-81b3d1d151e6 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:16.020237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:16.042288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b9bf9-43d2-438a-b768-14911b7f9f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:16.042981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b9bf9-43d2-438a-b768-14911b7f9f8e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:16.043257 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b9bf9-43d2-438a-b768-14911b7f9f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:16.043524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b9bf9-43d2-438a-b768-14911b7f9f8e None admin] PATH_INFO: `/v3/users/ff587d68b0de4327bd4c0d90116b3380` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:16.045430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b9bf9-43d2-438a-b768-14911b7f9f8e None admin] RBAC: Authorizing `identity:get_user(user_id=ff587d68b0de4327bd4c0d90116b3380)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:16.046914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b9bf9-43d2-438a-b768-14911b7f9f8e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:16.048814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 85/168] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:15 2022] GET /identity/v3/users/ff587d68b0de4327bd4c0d90116b3380 => generated 247 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:16.054593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b9bf9-43d2-438a-b768-14911b7f9f8e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:16.085968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f16646-e7f5-468f-9279-fe470181817a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:16.087482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f16646-e7f5-468f-9279-fe470181817a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:16.163339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:16.254292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b9bf9-43d2-438a-b768-14911b7f9f8e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:16.263784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 84/169] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:16.264923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f16646-e7f5-468f-9279-fe470181817a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:16.293914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa0d10-c883-40f4-9c25-c3ad679c1a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:16.294547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa0d10-c883-40f4-9c25-c3ad679c1a7a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:16.294796 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa0d10-c883-40f4-9c25-c3ad679c1a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:16.295063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa0d10-c883-40f4-9c25-c3ad679c1a7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:16.355837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:16.366378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa0d10-c883-40f4-9c25-c3ad679c1a7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:16.367851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa0d10-c883-40f4-9c25-c3ad679c1a7a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:16.463671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f16646-e7f5-468f-9279-fe470181817a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:16.471513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 86/170] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:05:16.472366 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa0d10-c883-40f4-9c25-c3ad679c1a7a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:16.533313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b606c-7601-4264-97a2-b28743ad4911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:16.537972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b606c-7601-4264-97a2-b28743ad4911 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:16.538268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b606c-7601-4264-97a2-b28743ad4911 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:16.538552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b606c-7601-4264-97a2-b28743ad4911 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:16.558544 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b606c-7601-4264-97a2-b28743ad4911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a53b606c-7601-4264-97a2-b28743ad4911 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:16.564722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:16.565618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:16.566413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:16.566999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:16.567068 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 85/171] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:16.567937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b606c-7601-4264-97a2-b28743ad4911 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:16.580394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa0d10-c883-40f4-9c25-c3ad679c1a7a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:16.591857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:16.634108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018cbd7-2815-40a0-a33f-15e2fa19cd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:16.634768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018cbd7-2815-40a0-a33f-15e2fa19cd97 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:16.635043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018cbd7-2815-40a0-a33f-15e2fa19cd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:16.635305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018cbd7-2815-40a0-a33f-15e2fa19cd97 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:16.636495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018cbd7-2815-40a0-a33f-15e2fa19cd97 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:16.638624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018cbd7-2815-40a0-a33f-15e2fa19cd97 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:16.640261 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 87/172] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:16 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:16.641021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018cbd7-2815-40a0-a33f-15e2fa19cd97 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:16.714374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b606c-7601-4264-97a2-b28743ad4911 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:16.751202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201d12f-3e8a-40ae-80ee-f997afa5bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:16.752019 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201d12f-3e8a-40ae-80ee-f997afa5bb02 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:16.752405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201d12f-3e8a-40ae-80ee-f997afa5bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:16.752784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201d12f-3e8a-40ae-80ee-f997afa5bb02 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:16.754071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201d12f-3e8a-40ae-80ee-f997afa5bb02 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:16.755646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201d12f-3e8a-40ae-80ee-f997afa5bb02 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:16.757529 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 86/173] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:16 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:16.758548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201d12f-3e8a-40ae-80ee-f997afa5bb02 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:16.768209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018cbd7-2815-40a0-a33f-15e2fa19cd97 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:16.861731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:16.869481 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201d12f-3e8a-40ae-80ee-f997afa5bb02 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:16.887283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd582d51-f3d7-4ca2-88b4-f55e3b409f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:16.887283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd582d51-f3d7-4ca2-88b4-f55e3b409f17 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:16.887283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd582d51-f3d7-4ca2-88b4-f55e3b409f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:16.887283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd582d51-f3d7-4ca2-88b4-f55e3b409f17 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:16.888346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd582d51-f3d7-4ca2-88b4-f55e3b409f17 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:16.892828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd582d51-f3d7-4ca2-88b4-f55e3b409f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:16.892828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd582d51-f3d7-4ca2-88b4-f55e3b409f17 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:16.908164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02100e76-4b26-4536-b27e-374bfe84d1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:16.908783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02100e76-4b26-4536-b27e-374bfe84d1ce None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:16.909061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02100e76-4b26-4536-b27e-374bfe84d1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:16.909333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02100e76-4b26-4536-b27e-374bfe84d1ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:16.910104 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02100e76-4b26-4536-b27e-374bfe84d1ce None admin] RBAC: Adding query filter params (role.id=a64cd92139fb4f1fb64f05f5a88f999f, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad, user.id=7d8d47bc48854f978d82fae1c6ad4c94) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:16.910411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02100e76-4b26-4536-b27e-374bfe84d1ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:16.912012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02100e76-4b26-4536-b27e-374bfe84d1ce None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:16.915728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 88/174] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:16.916662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd582d51-f3d7-4ca2-88b4-f55e3b409f17 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:16.939327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 87/175] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:16 2022] GET /identity/v3/role_assignments?user.id=7d8d47bc48854f978d82fae1c6ad4c94&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:16.940600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65b3e7-11ce-4840-84e8-dc8625f3cd8f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:16.940881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65b3e7-11ce-4840-84e8-dc8625f3cd8f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:16.941152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65b3e7-11ce-4840-84e8-dc8625f3cd8f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:16.942649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 88/176] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:16.943370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65b3e7-11ce-4840-84e8-dc8625f3cd8f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:16.948973 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:17.128507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd582d51-f3d7-4ca2-88b4-f55e3b409f17 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:17.192121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce70e8-9301-4f69-b8de-816089a69400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:17.192755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce70e8-9301-4f69-b8de-816089a69400 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:17.193034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce70e8-9301-4f69-b8de-816089a69400 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:17.193305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce70e8-9301-4f69-b8de-816089a69400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:17.194087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce70e8-9301-4f69-b8de-816089a69400 None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad, user.id=ff587d68b0de4327bd4c0d90116b3380) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:17.195071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce70e8-9301-4f69-b8de-816089a69400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:17.196598 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce70e8-9301-4f69-b8de-816089a69400 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:17.204867 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 89/177] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:16 2022] GET /identity/v3/role_assignments?user.id=ff587d68b0de4327bd4c0d90116b3380&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=28beda93f70d4c549352145ddee01aac => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:17.206701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bcd06-4419-4e2a-838a-91e029468448 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:17.206992 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bcd06-4419-4e2a-838a-91e029468448 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:17.207265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bcd06-4419-4e2a-838a-91e029468448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:17.230202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-bc6bcd06-4419-4e2a-838a-91e029468448 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:17.233213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bc6bcd06-4419-4e2a-838a-91e029468448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:17.259076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65b3e7-11ce-4840-84e8-dc8625f3cd8f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:17.337563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f76eb-db61-46df-953b-abc6276edb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:17.338236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f76eb-db61-46df-953b-abc6276edb78 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:17.338511 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f76eb-db61-46df-953b-abc6276edb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:17.338785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f76eb-db61-46df-953b-abc6276edb78 None admin] PATH_INFO: `/v3/users/7d8d47bc48854f978d82fae1c6ad4c94` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:17.341313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f76eb-db61-46df-953b-abc6276edb78 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8d47bc48854f978d82fae1c6ad4c94)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:17.343286 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f76eb-db61-46df-953b-abc6276edb78 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:17.344945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 89/178] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:16 2022] GET /identity/v3/users/7d8d47bc48854f978d82fae1c6ad4c94 => generated 275 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:17.352770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 90/179] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:17.353722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bcd06-4419-4e2a-838a-91e029468448 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:17.354635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4837c6-2e4c-4321-9ab6-ad7997f31120 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:17.354927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4837c6-2e4c-4321-9ab6-ad7997f31120 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:17.355195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4837c6-2e4c-4321-9ab6-ad7997f31120 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:17.357312 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 90/180] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:17 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:17.365744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e276c-82ae-492f-9cc6-6f431e14c2ab None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:17.366324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e276c-82ae-492f-9cc6-6f431e14c2ab None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:17.366802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e276c-82ae-492f-9cc6-6f431e14c2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:17.375353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:17.406594 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d62e276c-82ae-492f-9cc6-6f431e14c2ab None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:17.407918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d62e276c-82ae-492f-9cc6-6f431e14c2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:17.410141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:17.492437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 91/181] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:17.495046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f4d2a-a547-4aa0-8b48-0c2f2cb4d761 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:17.495324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f4d2a-a547-4aa0-8b48-0c2f2cb4d761 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:17.495590 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f4d2a-a547-4aa0-8b48-0c2f2cb4d761 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:17.496875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 92/182] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:17.506419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316da8e9-b12e-4fb0-b712-ce527136a559 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:17.506696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316da8e9-b12e-4fb0-b712-ce527136a559 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:17.506968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316da8e9-b12e-4fb0-b712-ce527136a559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:17.511128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bcd06-4419-4e2a-838a-91e029468448 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:17.542398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-316da8e9-b12e-4fb0-b712-ce527136a559 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:17.543609 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-316da8e9-b12e-4fb0-b712-ce527136a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:17.573111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d096a2b-96d6-495b-9a58-d671b8c0f558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:17.573753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d096a2b-96d6-495b-9a58-d671b8c0f558 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:17.576015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d096a2b-96d6-495b-9a58-d671b8c0f558 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:17.576278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d096a2b-96d6-495b-9a58-d671b8c0f558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:17.671034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 93/183] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:17.704560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316da8e9-b12e-4fb0-b712-ce527136a559 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:17.712299 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d096a2b-96d6-495b-9a58-d671b8c0f558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:17.713818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d096a2b-96d6-495b-9a58-d671b8c0f558 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:17.745721 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:17.836444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:17.859336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 91/184] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:17.862790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d096a2b-96d6-495b-9a58-d671b8c0f558 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:17.876508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316da8e9-b12e-4fb0-b712-ce527136a559 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:17.912515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265598d-002d-45cb-acd8-3a7d11265629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:17.913478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265598d-002d-45cb-acd8-3a7d11265629 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:17.913955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265598d-002d-45cb-acd8-3a7d11265629 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:17.914423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265598d-002d-45cb-acd8-3a7d11265629 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:17.927422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265598d-002d-45cb-acd8-3a7d11265629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b265598d-002d-45cb-acd8-3a7d11265629 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:17.932763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:17.933678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:17.935669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 94/185] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:17.940349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265598d-002d-45cb-acd8-3a7d11265629 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:18.003515 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d096a2b-96d6-495b-9a58-d671b8c0f558 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:18.024412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:18.047282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e477d3-1fae-475b-9236-b06e1e89ead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:18.047920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e477d3-1fae-475b-9236-b06e1e89ead3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:18.048195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e477d3-1fae-475b-9236-b06e1e89ead3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:18.048464 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e477d3-1fae-475b-9236-b06e1e89ead3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:18.049592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e477d3-1fae-475b-9236-b06e1e89ead3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:18.051796 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e477d3-1fae-475b-9236-b06e1e89ead3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:18.057199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265598d-002d-45cb-acd8-3a7d11265629 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:18.061579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 92/186] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:18.062454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e477d3-1fae-475b-9236-b06e1e89ead3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:18.088093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:18.097250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5cf3a-e9c3-43dc-bddf-5b53220d0efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:18.098302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5cf3a-e9c3-43dc-bddf-5b53220d0efb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:18.098302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5cf3a-e9c3-43dc-bddf-5b53220d0efb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:18.098542 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5cf3a-e9c3-43dc-bddf-5b53220d0efb None admin] PATH_INFO: `/v3/projects/0e772e96b4af4dd1baba525f6d422807` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:18.099676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5cf3a-e9c3-43dc-bddf-5b53220d0efb None admin] RBAC: Authorizing `identity:get_project(project_id=0e772e96b4af4dd1baba525f6d422807)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:18.101256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5cf3a-e9c3-43dc-bddf-5b53220d0efb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:18.108696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 95/187] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:17 2022] GET /identity/v3/projects/0e772e96b4af4dd1baba525f6d422807 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:18.109275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5cf3a-e9c3-43dc-bddf-5b53220d0efb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:18.173062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e477d3-1fae-475b-9236-b06e1e89ead3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:18.210262 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc8fa8-8ed6-4ac5-bcc8-dc9f66027778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:18.210832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8fa8-8ed6-4ac5-bcc8-dc9f66027778 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:18.211342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8fa8-8ed6-4ac5-bcc8-dc9f66027778 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:18.211342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8fa8-8ed6-4ac5-bcc8-dc9f66027778 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:18.211966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc8fa8-8ed6-4ac5-bcc8-dc9f66027778 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:18.212264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc8fa8-8ed6-4ac5-bcc8-dc9f66027778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:18.213772 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc8fa8-8ed6-4ac5-bcc8-dc9f66027778 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:18.217966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5cf3a-e9c3-43dc-bddf-5b53220d0efb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:18.227302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 93/188] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:18.227302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc8fa8-8ed6-4ac5-bcc8-dc9f66027778 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:18.256608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fee25-8bf0-4c15-af21-edd01ac4b215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:18.257239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fee25-8bf0-4c15-af21-edd01ac4b215 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:18.257567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fee25-8bf0-4c15-af21-edd01ac4b215 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:18.257846 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fee25-8bf0-4c15-af21-edd01ac4b215 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:18.268535 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fee25-8bf0-4c15-af21-edd01ac4b215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a13fee25-8bf0-4c15-af21-edd01ac4b215 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:18.273687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:18.275587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:18.276398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:18.277007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 96/189] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:18.277413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fee25-8bf0-4c15-af21-edd01ac4b215 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:18.289826 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:18.339670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:18.353443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc8fa8-8ed6-4ac5-bcc8-dc9f66027778 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:18.386367 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fee25-8bf0-4c15-af21-edd01ac4b215 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:18.389175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cc2db-cc0f-497b-b741-991380e7bcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:18.389911 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cc2db-cc0f-497b-b741-991380e7bcfd None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:18.390251 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cc2db-cc0f-497b-b741-991380e7bcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:18.390593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cc2db-cc0f-497b-b741-991380e7bcfd None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:18.391240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cc2db-cc0f-497b-b741-991380e7bcfd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:18.392693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cc2db-cc0f-497b-b741-991380e7bcfd None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:18.423248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe1087-7907-4b9e-ab47-9ee66d388a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:18.423855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1087-7907-4b9e-ab47-9ee66d388a90 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:18.424134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1087-7907-4b9e-ab47-9ee66d388a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:18.424407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1087-7907-4b9e-ab47-9ee66d388a90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:18.425130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe1087-7907-4b9e-ab47-9ee66d388a90 None admin] RBAC: Adding query filter params (role.id=a64cd92139fb4f1fb64f05f5a88f999f, scope.project.id=0e772e96b4af4dd1baba525f6d422807, user.id=7d8d47bc48854f978d82fae1c6ad4c94) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:18.425470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe1087-7907-4b9e-ab47-9ee66d388a90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:18.426920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe1087-7907-4b9e-ab47-9ee66d388a90 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:18.432710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 97/190] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:18 2022] GET /identity/v3/role_assignments?user.id=7d8d47bc48854f978d82fae1c6ad4c94&scope.project.id=0e772e96b4af4dd1baba525f6d422807&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:18.433518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe1087-7907-4b9e-ab47-9ee66d388a90 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:18.494343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 94/191] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:18 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:18.495536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cc2db-cc0f-497b-b741-991380e7bcfd None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:18.578983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe1087-7907-4b9e-ab47-9ee66d388a90 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:18.608971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:18.624904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bccbb-ba60-4f36-aab9-2681198c05b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:18.625593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bccbb-ba60-4f36-aab9-2681198c05b0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:18.625879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bccbb-ba60-4f36-aab9-2681198c05b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:18.626149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bccbb-ba60-4f36-aab9-2681198c05b0 None admin] PATH_INFO: `/v3/users/1fa4c84fc21f41bb88cf25c2006ede55` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:18.629703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:18.632871 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cc2db-cc0f-497b-b741-991380e7bcfd None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:18.647845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bccbb-ba60-4f36-aab9-2681198c05b0 None admin] RBAC: Authorizing `identity:get_user(user_id=1fa4c84fc21f41bb88cf25c2006ede55)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:18.649438 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bccbb-ba60-4f36-aab9-2681198c05b0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:18.651219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 98/192] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:18 2022] GET /identity/v3/users/1fa4c84fc21f41bb88cf25c2006ede55 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:18.654864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966aedd-7601-4eb7-86c9-fc74c7c018ed None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:18.654864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966aedd-7601-4eb7-86c9-fc74c7c018ed None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:18.655082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966aedd-7601-4eb7-86c9-fc74c7c018ed None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:18.657397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 99/193] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:18.658611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966aedd-7601-4eb7-86c9-fc74c7c018ed None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:18.681661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4eb3-5a5a-4fb9-9e89-0b238ddaeabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:18.682327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4eb3-5a5a-4fb9-9e89-0b238ddaeabe None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:18.682653 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4eb3-5a5a-4fb9-9e89-0b238ddaeabe None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:18.682925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4eb3-5a5a-4fb9-9e89-0b238ddaeabe None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:18.683601 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb4eb3-5a5a-4fb9-9e89-0b238ddaeabe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:18.683896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb4eb3-5a5a-4fb9-9e89-0b238ddaeabe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:18.685578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb4eb3-5a5a-4fb9-9e89-0b238ddaeabe None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:18.698162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 95/194] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:18.699391 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5af3-8aad-4f85-aa15-04ff5737514b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:18.699618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5af3-8aad-4f85-aa15-04ff5737514b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:18.700461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5af3-8aad-4f85-aa15-04ff5737514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:18.719653 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ae0a5af3-8aad-4f85-aa15-04ff5737514b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:18.720844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ae0a5af3-8aad-4f85-aa15-04ff5737514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:18.789762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966aedd-7601-4eb7-86c9-fc74c7c018ed None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:18.811178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 96/195] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:18.812357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a5af3-8aad-4f85-aa15-04ff5737514b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:18.834296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072651aa-ba6d-41b2-9f59-7a00404a7fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:18.834537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072651aa-ba6d-41b2-9f59-7a00404a7fdd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:18.834771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072651aa-ba6d-41b2-9f59-7a00404a7fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:18.834934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072651aa-ba6d-41b2-9f59-7a00404a7fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:18.890220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:18.915381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072651aa-ba6d-41b2-9f59-7a00404a7fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:18.917350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072651aa-ba6d-41b2-9f59-7a00404a7fdd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:18.946460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:18.958101 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a5af3-8aad-4f85-aa15-04ff5737514b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:19.005102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aff54c-b486-4324-aa7c-97e90ebba64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:19.005879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aff54c-b486-4324-aa7c-97e90ebba64b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:19.006228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aff54c-b486-4324-aa7c-97e90ebba64b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:19.006575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aff54c-b486-4324-aa7c-97e90ebba64b None admin] PATH_INFO: `/v3/users/1fa4c84fc21f41bb88cf25c2006ede55` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:19.007877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aff54c-b486-4324-aa7c-97e90ebba64b None admin] RBAC: Authorizing `identity:get_user(user_id=1fa4c84fc21f41bb88cf25c2006ede55)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:19.009436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aff54c-b486-4324-aa7c-97e90ebba64b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:19.011757 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 97/196] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:18 2022] GET /identity/v3/users/1fa4c84fc21f41bb88cf25c2006ede55 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:19.018225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aff54c-b486-4324-aa7c-97e90ebba64b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:19.040168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 100/197] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:05:19.046242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072651aa-ba6d-41b2-9f59-7a00404a7fdd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:19.166380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:19.167583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aff54c-b486-4324-aa7c-97e90ebba64b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:19.192883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072651aa-ba6d-41b2-9f59-7a00404a7fdd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:19.206579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014b33b-5212-4317-bc37-d111c2851fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:19.207338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014b33b-5212-4317-bc37-d111c2851fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:19.207740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014b33b-5212-4317-bc37-d111c2851fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:19.208113 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014b33b-5212-4317-bc37-d111c2851fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:19.231959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857386d4-a1d9-4a56-9477-cd2502d8f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:19.232954 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857386d4-a1d9-4a56-9477-cd2502d8f033 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:19.233402 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857386d4-a1d9-4a56-9477-cd2502d8f033 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:19.233820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857386d4-a1d9-4a56-9477-cd2502d8f033 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:19.235116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857386d4-a1d9-4a56-9477-cd2502d8f033 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:19.236816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857386d4-a1d9-4a56-9477-cd2502d8f033 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:19.243501 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:19.243832 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 101/198] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:19 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:19.244914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857386d4-a1d9-4a56-9477-cd2502d8f033 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:19.301111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014b33b-5212-4317-bc37-d111c2851fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:19.302557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014b33b-5212-4317-bc37-d111c2851fc9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:19.357460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857386d4-a1d9-4a56-9477-cd2502d8f033 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:19.398658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4c802-37a0-44e7-a0b6-3b6dbd795a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:19.399656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4c802-37a0-44e7-a0b6-3b6dbd795a6c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:19.400137 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4c802-37a0-44e7-a0b6-3b6dbd795a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:19.400639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4c802-37a0-44e7-a0b6-3b6dbd795a6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:19.412145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4c802-37a0-44e7-a0b6-3b6dbd795a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-fdc4c802-37a0-44e7-a0b6-3b6dbd795a6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:19.417684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:19.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:19.419911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:19.422160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 102/199] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:19.423226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4c802-37a0-44e7-a0b6-3b6dbd795a6c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:19.433095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:19.442933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 98/200] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:19.443870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014b33b-5212-4317-bc37-d111c2851fc9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:19.523209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:19.546467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4c802-37a0-44e7-a0b6-3b6dbd795a6c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:19.569314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014b33b-5212-4317-bc37-d111c2851fc9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:19.583810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a2f4-67f6-431c-bbd5-f40a84f12417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:19.584676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a2f4-67f6-431c-bbd5-f40a84f12417 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:19.584676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a2f4-67f6-431c-bbd5-f40a84f12417 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:19.584950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626a2f4-67f6-431c-bbd5-f40a84f12417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:19.585718 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626a2f4-67f6-431c-bbd5-f40a84f12417 None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=cd7db93d6ee541a491174595f83a43ef, user.id=1fa4c84fc21f41bb88cf25c2006ede55) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:19.586024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626a2f4-67f6-431c-bbd5-f40a84f12417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:19.587489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626a2f4-67f6-431c-bbd5-f40a84f12417 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:19.593919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 103/201] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:19 2022] GET /identity/v3/role_assignments?user.id=1fa4c84fc21f41bb88cf25c2006ede55&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=28beda93f70d4c549352145ddee01aac => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:19.594731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a2f4-67f6-431c-bbd5-f40a84f12417 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:19.609224 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc650d-0e68-4680-bba0-3696b34d7118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:19.610283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc650d-0e68-4680-bba0-3696b34d7118 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:19.610769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc650d-0e68-4680-bba0-3696b34d7118 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:19.611367 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc650d-0e68-4680-bba0-3696b34d7118 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:19.612268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc650d-0e68-4680-bba0-3696b34d7118 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:19.612847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc650d-0e68-4680-bba0-3696b34d7118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:19.614583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc650d-0e68-4680-bba0-3696b34d7118 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:19.625309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 99/202] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:19.631919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc650d-0e68-4680-bba0-3696b34d7118 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:19.779282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:19.816504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc650d-0e68-4680-bba0-3696b34d7118 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:19.844148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:19.855464 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626a2f4-67f6-431c-bbd5-f40a84f12417 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:19.858700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d0e4e-5c9c-40d3-8f3e-27c97fc98b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:19.859541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d0e4e-5c9c-40d3-8f3e-27c97fc98b1d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:19.859986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d0e4e-5c9c-40d3-8f3e-27c97fc98b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:19.873570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d0e4e-5c9c-40d3-8f3e-27c97fc98b1d None admin] PATH_INFO: `/v3/users/da62ae5d32124852b1a3bd0b425bcf54` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:19.873570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d0e4e-5c9c-40d3-8f3e-27c97fc98b1d None admin] RBAC: Authorizing `identity:get_user(user_id=da62ae5d32124852b1a3bd0b425bcf54)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:19.873570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d0e4e-5c9c-40d3-8f3e-27c97fc98b1d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:19.873570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 100/203] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:19 2022] GET /identity/v3/users/da62ae5d32124852b1a3bd0b425bcf54 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:19.873570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d0e4e-5c9c-40d3-8f3e-27c97fc98b1d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:19.914085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535872d-4615-49ff-b8af-ba146056c752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:19.914821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535872d-4615-49ff-b8af-ba146056c752 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:19.915109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535872d-4615-49ff-b8af-ba146056c752 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:19.915381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535872d-4615-49ff-b8af-ba146056c752 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:19.917548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535872d-4615-49ff-b8af-ba146056c752 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:19.919126 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535872d-4615-49ff-b8af-ba146056c752 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:19.925554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 104/204] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:19 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:19.930057 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535872d-4615-49ff-b8af-ba146056c752 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:20.072156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d0e4e-5c9c-40d3-8f3e-27c97fc98b1d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:20.115417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f184dd-d62a-4bb3-b145-e6a1dbcdf0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:20.116562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f184dd-d62a-4bb3-b145-e6a1dbcdf0cb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:20.117670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f184dd-d62a-4bb3-b145-e6a1dbcdf0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:20.118290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f184dd-d62a-4bb3-b145-e6a1dbcdf0cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:20.135715 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535872d-4615-49ff-b8af-ba146056c752 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:20.198931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7cb52-d9ae-4009-9675-ec81c4a74130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:20.199553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7cb52-d9ae-4009-9675-ec81c4a74130 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:20.199865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7cb52-d9ae-4009-9675-ec81c4a74130 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:20.200145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7cb52-d9ae-4009-9675-ec81c4a74130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:20.200885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7cb52-d9ae-4009-9675-ec81c4a74130 None admin] RBAC: Adding query filter params (role.id=68da777efbc34e15a79e851577a8ee89, scope.project.id=cd7db93d6ee541a491174595f83a43ef, user.id=1fa4c84fc21f41bb88cf25c2006ede55) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:20.201196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7cb52-d9ae-4009-9675-ec81c4a74130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:20.204681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7cb52-d9ae-4009-9675-ec81c4a74130 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:20.217428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 105/205] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:19 2022] GET /identity/v3/role_assignments?user.id=1fa4c84fc21f41bb88cf25c2006ede55&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=68da777efbc34e15a79e851577a8ee89 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:20.229868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f184dd-d62a-4bb3-b145-e6a1dbcdf0cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:20.232069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f184dd-d62a-4bb3-b145-e6a1dbcdf0cb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:20.254226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:20.354607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 101/206] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:20.361625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7cb52-d9ae-4009-9675-ec81c4a74130 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:20.364613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:20.477093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7cb52-d9ae-4009-9675-ec81c4a74130 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:20.513686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd634ec-cdfc-49f5-ae77-2b51e2d77286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:20.514335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd634ec-cdfc-49f5-ae77-2b51e2d77286 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:20.514613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd634ec-cdfc-49f5-ae77-2b51e2d77286 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:20.514886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd634ec-cdfc-49f5-ae77-2b51e2d77286 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:20.516099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd634ec-cdfc-49f5-ae77-2b51e2d77286 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:20.517586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd634ec-cdfc-49f5-ae77-2b51e2d77286 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:20.519238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 106/207] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:20 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:20.525243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f184dd-d62a-4bb3-b145-e6a1dbcdf0cb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:20.636695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:20.651594 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f184dd-d62a-4bb3-b145-e6a1dbcdf0cb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:20.696863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf542d-19d2-4378-9f68-d4cfcb7a3d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:20.697825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf542d-19d2-4378-9f68-d4cfcb7a3d84 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:20.698103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf542d-19d2-4378-9f68-d4cfcb7a3d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:20.698415 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf542d-19d2-4378-9f68-d4cfcb7a3d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:20.699163 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf542d-19d2-4378-9f68-d4cfcb7a3d84 None admin] RBAC: Adding query filter params (role.id=fca599016d83441ab8908df85d7fcbbd, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad, user.id=da62ae5d32124852b1a3bd0b425bcf54) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:20.699466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf542d-19d2-4378-9f68-d4cfcb7a3d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:20.701993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf542d-19d2-4378-9f68-d4cfcb7a3d84 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:20.710529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 102/208] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:20 2022] GET /identity/v3/role_assignments?user.id=da62ae5d32124852b1a3bd0b425bcf54&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=fca599016d83441ab8908df85d7fcbbd => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:20.934238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262b44-8d06-44cb-a5b1-707af4c5277e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:20.934624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262b44-8d06-44cb-a5b1-707af4c5277e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:20.934802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262b44-8d06-44cb-a5b1-707af4c5277e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:20.936391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 107/209] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:20.941925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb5758-5c97-43af-b350-c5a9d359b0c5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:20.942208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb5758-5c97-43af-b350-c5a9d359b0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:20.942479 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb5758-5c97-43af-b350-c5a9d359b0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:20.963905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-48fb5758-5c97-43af-b350-c5a9d359b0c5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:20.965103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-48fb5758-5c97-43af-b350-c5a9d359b0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:21.057853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 103/210] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:21.061666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393ae80-23e8-4c6d-b386-f593b307d6ca None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:21.061952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393ae80-23e8-4c6d-b386-f593b307d6ca None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:21.062225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393ae80-23e8-4c6d-b386-f593b307d6ca None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:21.063565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 108/211] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:05:21.072613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d664e8-a43c-4dfd-9bab-0210dabaf8f5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:21.072902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d664e8-a43c-4dfd-9bab-0210dabaf8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:21.073178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d664e8-a43c-4dfd-9bab-0210dabaf8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:21.094781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d9d664e8-a43c-4dfd-9bab-0210dabaf8f5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:21.095977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d9d664e8-a43c-4dfd-9bab-0210dabaf8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:21.173694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 104/212] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:21.362958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393ae80-23e8-4c6d-b386-f593b307d6ca None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:21.437069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:21.451546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d664e8-a43c-4dfd-9bab-0210dabaf8f5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:21.468122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:21.470175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393ae80-23e8-4c6d-b386-f593b307d6ca None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:21.506801 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83346c-66c3-44cb-b460-00b30428aecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:21.507440 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83346c-66c3-44cb-b460-00b30428aecf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:21.507717 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83346c-66c3-44cb-b460-00b30428aecf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:21.507989 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83346c-66c3-44cb-b460-00b30428aecf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:21.519220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83346c-66c3-44cb-b460-00b30428aecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ce83346c-66c3-44cb-b460-00b30428aecf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:21.524071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:21.524995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:21.525867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 109/213] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:21.531265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83346c-66c3-44cb-b460-00b30428aecf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:21.569246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d664e8-a43c-4dfd-9bab-0210dabaf8f5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:21.607543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61dc71-c4f2-45c9-a5db-637cebd4e63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:21.608526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61dc71-c4f2-45c9-a5db-637cebd4e63f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:21.609024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61dc71-c4f2-45c9-a5db-637cebd4e63f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:21.609544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61dc71-c4f2-45c9-a5db-637cebd4e63f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:21.610874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61dc71-c4f2-45c9-a5db-637cebd4e63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:21.612563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61dc71-c4f2-45c9-a5db-637cebd4e63f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:21.618975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 105/214] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:21.620095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61dc71-c4f2-45c9-a5db-637cebd4e63f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:21.643299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83346c-66c3-44cb-b460-00b30428aecf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:21.673956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:21.680673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0cdcd-20d9-44a4-abdb-001dcff6eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:21.681507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0cdcd-20d9-44a4-abdb-001dcff6eb55 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:21.685602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0cdcd-20d9-44a4-abdb-001dcff6eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:21.685602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0cdcd-20d9-44a4-abdb-001dcff6eb55 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:21.685602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0cdcd-20d9-44a4-abdb-001dcff6eb55 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:21.685602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0cdcd-20d9-44a4-abdb-001dcff6eb55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:21.685602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0cdcd-20d9-44a4-abdb-001dcff6eb55 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:21.694227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 110/215] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:21.699853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0cdcd-20d9-44a4-abdb-001dcff6eb55 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:21.713417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:21.732900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61dc71-c4f2-45c9-a5db-637cebd4e63f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:21.768185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79bb2d-49b8-4e00-89cc-26f484f293a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:21.768794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79bb2d-49b8-4e00-89cc-26f484f293a2 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:21.769069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79bb2d-49b8-4e00-89cc-26f484f293a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:21.769446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79bb2d-49b8-4e00-89cc-26f484f293a2 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:21.769993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79bb2d-49b8-4e00-89cc-26f484f293a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:21.771444 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79bb2d-49b8-4e00-89cc-26f484f293a2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:21.808160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0cdcd-20d9-44a4-abdb-001dcff6eb55 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:21.840874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2de80b-cb4c-4dc5-b482-8aca5f4da940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:21.841528 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2de80b-cb4c-4dc5-b482-8aca5f4da940 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:21.841805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2de80b-cb4c-4dc5-b482-8aca5f4da940 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:21.842072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2de80b-cb4c-4dc5-b482-8aca5f4da940 None admin] PATH_INFO: `/v3/users/469237a77f874dc09ba8566aad895bfc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:21.855701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2de80b-cb4c-4dc5-b482-8aca5f4da940 None admin] RBAC: Authorizing `identity:get_user(user_id=469237a77f874dc09ba8566aad895bfc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:21.857983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2de80b-cb4c-4dc5-b482-8aca5f4da940 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:21.859804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 111/216] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:21 2022] GET /identity/v3/users/469237a77f874dc09ba8566aad895bfc => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:21.861124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def4b0-9568-4318-bd09-115865a44a0c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:21.861422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def4b0-9568-4318-bd09-115865a44a0c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:21.861711 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57def4b0-9568-4318-bd09-115865a44a0c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:21.865485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 112/217] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:21.869231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 106/218] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:21 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:21.869336 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e53142-96ef-439a-b27a-0077c9c56c8d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:21.869336 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e53142-96ef-439a-b27a-0077c9c56c8d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:21.869499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79bb2d-49b8-4e00-89cc-26f484f293a2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:21.869601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e53142-96ef-439a-b27a-0077c9c56c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:21.893496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-34e53142-96ef-439a-b27a-0077c9c56c8d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:21.894867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-34e53142-96ef-439a-b27a-0077c9c56c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:21.968227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:21.998255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 113/219] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:22.001888 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79bb2d-49b8-4e00-89cc-26f484f293a2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:22.045693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6fb35-be02-4292-845e-c7d94138fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:22.045693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fb35-be02-4292-845e-c7d94138fb58 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:22.045693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fb35-be02-4292-845e-c7d94138fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:22.045693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fb35-be02-4292-845e-c7d94138fb58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:22.055552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:22.125513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6fb35-be02-4292-845e-c7d94138fb58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:22.127345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6fb35-be02-4292-845e-c7d94138fb58 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:22.236044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 107/220] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:22.241596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e53142-96ef-439a-b27a-0077c9c56c8d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:22.275564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6fb35-be02-4292-845e-c7d94138fb58 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:22.327890 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:22.367133 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e53142-96ef-439a-b27a-0077c9c56c8d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:22.409817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6fb35-be02-4292-845e-c7d94138fb58 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:22.410493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7631c-cc0a-4e61-9b20-409e076b85a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:22.411207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7631c-cc0a-4e61-9b20-409e076b85a4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:22.411551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7631c-cc0a-4e61-9b20-409e076b85a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:22.411890 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7631c-cc0a-4e61-9b20-409e076b85a4 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:22.414376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7631c-cc0a-4e61-9b20-409e076b85a4 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:22.415451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7631c-cc0a-4e61-9b20-409e076b85a4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:22.417202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 114/221] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:22 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:22.422997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7631c-cc0a-4e61-9b20-409e076b85a4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:22.455693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1062bc8-ec00-48dd-9620-c9cdbf88a076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:22.457169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062bc8-ec00-48dd-9620-c9cdbf88a076 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:22.457724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062bc8-ec00-48dd-9620-c9cdbf88a076 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:22.458145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062bc8-ec00-48dd-9620-c9cdbf88a076 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:22.473455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1062bc8-ec00-48dd-9620-c9cdbf88a076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a1062bc8-ec00-48dd-9620-c9cdbf88a076 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:22.480263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:22.481384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:22.482254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:22.484911 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 108/222] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:22.493466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:22.494605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1062bc8-ec00-48dd-9620-c9cdbf88a076 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:22.544802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7631c-cc0a-4e61-9b20-409e076b85a4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:22.581852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a490b-8ff1-497b-909d-31a1c074fcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:22.582734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a490b-8ff1-497b-909d-31a1c074fcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:22.583009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a490b-8ff1-497b-909d-31a1c074fcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:22.583277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a490b-8ff1-497b-909d-31a1c074fcb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:22.584007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a490b-8ff1-497b-909d-31a1c074fcb1 None admin] RBAC: Adding query filter params (role.id=a64cd92139fb4f1fb64f05f5a88f999f, scope.project.id=cd7db93d6ee541a491174595f83a43ef, user.id=469237a77f874dc09ba8566aad895bfc) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:22.584306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a490b-8ff1-497b-909d-31a1c074fcb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:22.585790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a490b-8ff1-497b-909d-31a1c074fcb1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:22.591651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 115/223] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:22 2022] GET /identity/v3/role_assignments?user.id=469237a77f874dc09ba8566aad895bfc&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:22.597044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fcbbb-8e33-4a28-b885-cacaaadb41b9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:22.597044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fcbbb-8e33-4a28-b885-cacaaadb41b9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:22.597044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fcbbb-8e33-4a28-b885-cacaaadb41b9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:22.597044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 116/224] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:22.599897 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb6967-447d-4ed9-bd09-164ba54e0f29 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:22.600175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb6967-447d-4ed9-bd09-164ba54e0f29 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:22.600446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb6967-447d-4ed9-bd09-164ba54e0f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:22.619668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5deb6967-447d-4ed9-bd09-164ba54e0f29 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:22.620864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5deb6967-447d-4ed9-bd09-164ba54e0f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:22.705540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 117/225] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:22.709004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:22.715917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1062bc8-ec00-48dd-9620-c9cdbf88a076 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:22.766702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b53b7-52ed-4109-aad7-68463c6233ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:22.767241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b53b7-52ed-4109-aad7-68463c6233ac None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:22.767557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b53b7-52ed-4109-aad7-68463c6233ac None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:22.767833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b53b7-52ed-4109-aad7-68463c6233ac None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:22.768521 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b53b7-52ed-4109-aad7-68463c6233ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:22.768823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b53b7-52ed-4109-aad7-68463c6233ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:22.770376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b53b7-52ed-4109-aad7-68463c6233ac None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:22.786144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 109/226] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:22.790793 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb6967-447d-4ed9-bd09-164ba54e0f29 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:22.869981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:22.964123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb6967-447d-4ed9-bd09-164ba54e0f29 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:23.000177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18865411-fadd-446c-a75f-b3c5b83aaa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:23.000806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18865411-fadd-446c-a75f-b3c5b83aaa84 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:23.001083 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18865411-fadd-446c-a75f-b3c5b83aaa84 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:23.001444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18865411-fadd-446c-a75f-b3c5b83aaa84 None admin] PATH_INFO: `/v3/users/1fa4c84fc21f41bb88cf25c2006ede55` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:23.002505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18865411-fadd-446c-a75f-b3c5b83aaa84 None admin] RBAC: Authorizing `identity:get_user(user_id=1fa4c84fc21f41bb88cf25c2006ede55)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:23.003949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18865411-fadd-446c-a75f-b3c5b83aaa84 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:23.005695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 118/227] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:22 2022] GET /identity/v3/users/1fa4c84fc21f41bb88cf25c2006ede55 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:23.011217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b53b7-52ed-4109-aad7-68463c6233ac None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:23.123081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b53b7-52ed-4109-aad7-68463c6233ac None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:23.142980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18865411-fadd-446c-a75f-b3c5b83aaa84 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:23.166110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942272f6-56bb-4ad3-a5bc-97dbea977c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:23.166743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942272f6-56bb-4ad3-a5bc-97dbea977c02 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:23.167012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942272f6-56bb-4ad3-a5bc-97dbea977c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:23.167277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942272f6-56bb-4ad3-a5bc-97dbea977c02 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:23.168927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942272f6-56bb-4ad3-a5bc-97dbea977c02 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:23.170670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942272f6-56bb-4ad3-a5bc-97dbea977c02 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:23.172759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 110/228] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:23 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:23.178904 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942272f6-56bb-4ad3-a5bc-97dbea977c02 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:23.233843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:23.313051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18865411-fadd-446c-a75f-b3c5b83aaa84 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:23.324046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:23.348403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d130e0-17c3-4ed2-83d1-2cf4815ef6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:23.349034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d130e0-17c3-4ed2-83d1-2cf4815ef6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:23.349308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d130e0-17c3-4ed2-83d1-2cf4815ef6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:23.349609 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d130e0-17c3-4ed2-83d1-2cf4815ef6a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:23.359120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942272f6-56bb-4ad3-a5bc-97dbea977c02 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:23.361785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d130e0-17c3-4ed2-83d1-2cf4815ef6a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-08d130e0-17c3-4ed2-83d1-2cf4815ef6a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:23.367241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:23.368553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:23.369335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 119/229] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:23.376780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d130e0-17c3-4ed2-83d1-2cf4815ef6a6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:23.450293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0bf38-1280-427a-ae48-74fc1113726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:23.451358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0bf38-1280-427a-ae48-74fc1113726e None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:23.451937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0bf38-1280-427a-ae48-74fc1113726e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:23.452405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0bf38-1280-427a-ae48-74fc1113726e None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef/users/1fa4c84fc21f41bb88cf25c2006ede55/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:23.458777 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0bf38-1280-427a-ae48-74fc1113726e None admin] RBAC: Authorizing `identity:create_grant(project_id=cd7db93d6ee541a491174595f83a43ef, user_id=1fa4c84fc21f41bb88cf25c2006ede55, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:23.460495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0bf38-1280-427a-ae48-74fc1113726e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:23.486842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d130e0-17c3-4ed2-83d1-2cf4815ef6a6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:23.521395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f160579-8985-4cf8-aede-4aada492e5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:23.522024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f160579-8985-4cf8-aede-4aada492e5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:23.522297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f160579-8985-4cf8-aede-4aada492e5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:23.522562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f160579-8985-4cf8-aede-4aada492e5e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:23.523239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f160579-8985-4cf8-aede-4aada492e5e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:23.523533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f160579-8985-4cf8-aede-4aada492e5e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:23.524943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f160579-8985-4cf8-aede-4aada492e5e3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:23.540864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 120/230] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:23.545403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f160579-8985-4cf8-aede-4aada492e5e3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:23.552667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 111/231] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:05:23 2022] PUT /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef/users/1fa4c84fc21f41bb88cf25c2006ede55/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:05:23.578708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:23.652038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f160579-8985-4cf8-aede-4aada492e5e3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:23.688391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228afd6-f1a8-4b54-a100-bd129ef59e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:23.689032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228afd6-f1a8-4b54-a100-bd129ef59e84 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:23.689305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228afd6-f1a8-4b54-a100-bd129ef59e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:23.689611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228afd6-f1a8-4b54-a100-bd129ef59e84 None admin] PATH_INFO: `/v3/users/1fa4c84fc21f41bb88cf25c2006ede55` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:23.690766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228afd6-f1a8-4b54-a100-bd129ef59e84 None admin] RBAC: Authorizing `identity:get_user(user_id=1fa4c84fc21f41bb88cf25c2006ede55)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:23.692241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228afd6-f1a8-4b54-a100-bd129ef59e84 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:23.694074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 121/232] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:23 2022] GET /identity/v3/users/1fa4c84fc21f41bb88cf25c2006ede55 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:23.700684 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0bf38-1280-427a-ae48-74fc1113726e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:23.811632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:23.826007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0bf38-1280-427a-ae48-74fc1113726e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:23.861858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8f285-5288-426c-8fd2-a4d89a9d0327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:23.862493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8f285-5288-426c-8fd2-a4d89a9d0327 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:23.862766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8f285-5288-426c-8fd2-a4d89a9d0327 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:23.863032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8f285-5288-426c-8fd2-a4d89a9d0327 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:23.864161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8f285-5288-426c-8fd2-a4d89a9d0327 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:23.865637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8f285-5288-426c-8fd2-a4d89a9d0327 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:23.867272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 112/233] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:23 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:23.873195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228afd6-f1a8-4b54-a100-bd129ef59e84 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:23.974887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:23.977907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228afd6-f1a8-4b54-a100-bd129ef59e84 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:24.013551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70625f-0e22-41f8-b0aa-ec9168eff567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:24.014210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70625f-0e22-41f8-b0aa-ec9168eff567 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:24.014486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70625f-0e22-41f8-b0aa-ec9168eff567 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:24.014758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70625f-0e22-41f8-b0aa-ec9168eff567 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef/users/1fa4c84fc21f41bb88cf25c2006ede55/roles/68da777efbc34e15a79e851577a8ee89` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:24.017411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70625f-0e22-41f8-b0aa-ec9168eff567 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd7db93d6ee541a491174595f83a43ef, user_id=1fa4c84fc21f41bb88cf25c2006ede55, role_id=68da777efbc34e15a79e851577a8ee89)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:24.018866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70625f-0e22-41f8-b0aa-ec9168eff567 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:24.130328 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 122/234] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:05:23 2022] PUT /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef/users/1fa4c84fc21f41bb88cf25c2006ede55/roles/68da777efbc34e15a79e851577a8ee89 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:24.568935 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028faeb-536c-4de3-adea-91f58b82d24d None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:24.569338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028faeb-536c-4de3-adea-91f58b82d24d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:24.569542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028faeb-536c-4de3-adea-91f58b82d24d None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:24.570882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 113/235] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:24.587348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4459b2e-b92f-497d-bd02-6a2c63f6b827 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:24.587840 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4459b2e-b92f-497d-bd02-6a2c63f6b827 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:24.587933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4459b2e-b92f-497d-bd02-6a2c63f6b827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:24.618426 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a4459b2e-b92f-497d-bd02-6a2c63f6b827 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:24.619667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a4459b2e-b92f-497d-bd02-6a2c63f6b827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:24.706806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 123/236] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:24.712327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a619-c7f0-4315-852d-5c046630ddf0 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:24.712611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a619-c7f0-4315-852d-5c046630ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:24.712884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a619-c7f0-4315-852d-5c046630ddf0 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:24.714405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 114/237] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:24.717977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7caa-cb84-4239-b257-fe78e4deb25a None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:24.718257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7caa-cb84-4239-b257-fe78e4deb25a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:24.718532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7caa-cb84-4239-b257-fe78e4deb25a None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:24.719968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 124/238] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:05:24.724983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca56742-d965-4664-9976-667403caa36d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:24.725260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca56742-d965-4664-9976-667403caa36d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:24.725562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca56742-d965-4664-9976-667403caa36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:24.737568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f0dea-cba7-43fe-b750-518cf60f5683 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:24.737873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f0dea-cba7-43fe-b750-518cf60f5683 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:24.738116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f0dea-cba7-43fe-b750-518cf60f5683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:24.757662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-cca56742-d965-4664-9976-667403caa36d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:24.758841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cca56742-d965-4664-9976-667403caa36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:24.775844 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8c7f0dea-cba7-43fe-b750-518cf60f5683 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:24.777080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8c7f0dea-cba7-43fe-b750-518cf60f5683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:24.874741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 115/239] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:24.903261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 125/240] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:24.988233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca56742-d965-4664-9976-667403caa36d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.101340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:25.121406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca56742-d965-4664-9976-667403caa36d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:25.162150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a03f5-a66f-4309-ae6e-925d9513fe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:25.162706 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a03f5-a66f-4309-ae6e-925d9513fe5a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:25.162983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a03f5-a66f-4309-ae6e-925d9513fe5a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:25.163255 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a03f5-a66f-4309-ae6e-925d9513fe5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:25.164376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a03f5-a66f-4309-ae6e-925d9513fe5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:25.165853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a03f5-a66f-4309-ae6e-925d9513fe5a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:25.167425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 116/241] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:25.173021 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f0dea-cba7-43fe-b750-518cf60f5683 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.203363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:25.227641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a03f5-a66f-4309-ae6e-925d9513fe5a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.282901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f0dea-cba7-43fe-b750-518cf60f5683 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:25.317771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6db6d-c190-457c-af15-195a71f869e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:25.318531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6db6d-c190-457c-af15-195a71f869e7 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:25.318904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6db6d-c190-457c-af15-195a71f869e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:25.319324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6db6d-c190-457c-af15-195a71f869e7 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:25.320151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6db6d-c190-457c-af15-195a71f869e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:25.321712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6db6d-c190-457c-af15-195a71f869e7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:25.335847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a03f5-a66f-4309-ae6e-925d9513fe5a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:25.371292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10540-7c91-45e6-b3ef-c4be1487af86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:25.372563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10540-7c91-45e6-b3ef-c4be1487af86 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:25.372838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10540-7c91-45e6-b3ef-c4be1487af86 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:25.373107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10540-7c91-45e6-b3ef-c4be1487af86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:25.383666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d10540-7c91-45e6-b3ef-c4be1487af86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-65d10540-7c91-45e6-b3ef-c4be1487af86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:25.388439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:25.389285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 117/242] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:25.390825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10540-7c91-45e6-b3ef-c4be1487af86 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.403031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 126/243] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:25 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:25.403834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6db6d-c190-457c-af15-195a71f869e7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.414196 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:25.506340 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:25.534646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6db6d-c190-457c-af15-195a71f869e7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:25.576593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30647b-b933-4786-b7b7-89343a50335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:25.577834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30647b-b933-4786-b7b7-89343a50335d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:25.578333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30647b-b933-4786-b7b7-89343a50335d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:25.578808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30647b-b933-4786-b7b7-89343a50335d None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:25.579685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30647b-b933-4786-b7b7-89343a50335d None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:25.580556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30647b-b933-4786-b7b7-89343a50335d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:25.582195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30647b-b933-4786-b7b7-89343a50335d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:25.593214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 127/244] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:25.601773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30647b-b933-4786-b7b7-89343a50335d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.616430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10540-7c91-45e6-b3ef-c4be1487af86 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:25.658334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc750360-f025-4f96-832c-4b6dc9c6d54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:25.659053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc750360-f025-4f96-832c-4b6dc9c6d54a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:25.659381 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc750360-f025-4f96-832c-4b6dc9c6d54a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:25.659661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc750360-f025-4f96-832c-4b6dc9c6d54a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:25.677876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc750360-f025-4f96-832c-4b6dc9c6d54a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-bc750360-f025-4f96-832c-4b6dc9c6d54a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:25.683181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:25.684116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:25.684925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 118/245] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:25.693185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc750360-f025-4f96-832c-4b6dc9c6d54a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.730178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30647b-b933-4786-b7b7-89343a50335d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:25.768314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b42f7-d5f2-4536-aaba-31e37b27767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:25.769008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b42f7-d5f2-4536-aaba-31e37b27767a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:25.769319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b42f7-d5f2-4536-aaba-31e37b27767a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:25.769689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b42f7-d5f2-4536-aaba-31e37b27767a None admin] PATH_INFO: `/v3/users/469237a77f874dc09ba8566aad895bfc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:25.770979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b42f7-d5f2-4536-aaba-31e37b27767a None admin] RBAC: Authorizing `identity:get_user(user_id=469237a77f874dc09ba8566aad895bfc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:25.772434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b42f7-d5f2-4536-aaba-31e37b27767a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:25.774270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 128/246] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:25 2022] GET /identity/v3/users/469237a77f874dc09ba8566aad895bfc => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:25.779519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b42f7-d5f2-4536-aaba-31e37b27767a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.788778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:25.797082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:25.828943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc750360-f025-4f96-832c-4b6dc9c6d54a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:25.872732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9f5c3-cf96-433b-9094-4d73e138d162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:25.874012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f5c3-cf96-433b-9094-4d73e138d162 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:25.874383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f5c3-cf96-433b-9094-4d73e138d162 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:25.874746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f5c3-cf96-433b-9094-4d73e138d162 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:25.875508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9f5c3-cf96-433b-9094-4d73e138d162 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:25.876072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9f5c3-cf96-433b-9094-4d73e138d162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:25.877792 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9f5c3-cf96-433b-9094-4d73e138d162 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:25.892368 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 119/247] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:25.897531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9f5c3-cf96-433b-9094-4d73e138d162 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.908225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b42f7-d5f2-4536-aaba-31e37b27767a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:25.945226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4c68e-61f5-4ce8-a0dc-11af5b70e8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:25.945889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4c68e-61f5-4ce8-a0dc-11af5b70e8ad None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:25.946168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4c68e-61f5-4ce8-a0dc-11af5b70e8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:25.946634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4c68e-61f5-4ce8-a0dc-11af5b70e8ad None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:25.948233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4c68e-61f5-4ce8-a0dc-11af5b70e8ad None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:25.949957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4c68e-61f5-4ce8-a0dc-11af5b70e8ad None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:25.957101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 129/248] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:25 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:25.958036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4c68e-61f5-4ce8-a0dc-11af5b70e8ad None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:26.010148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9f5c3-cf96-433b-9094-4d73e138d162 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:26.047920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c8199-e043-4c1e-97f8-180108ed6d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:26.048563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8199-e043-4c1e-97f8-180108ed6d77 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:26.048835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8199-e043-4c1e-97f8-180108ed6d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:26.049107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8199-e043-4c1e-97f8-180108ed6d77 None admin] PATH_INFO: `/v3/users/72a43971412348919a247e06c1828c81` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:26.050613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:26.052159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:26.066646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c8199-e043-4c1e-97f8-180108ed6d77 None admin] RBAC: Authorizing `identity:get_user(user_id=72a43971412348919a247e06c1828c81)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:26.067864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c8199-e043-4c1e-97f8-180108ed6d77 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:26.069978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 120/249] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:25 2022] GET /identity/v3/users/72a43971412348919a247e06c1828c81 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:26.075858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c8199-e043-4c1e-97f8-180108ed6d77 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:26.083030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4c68e-61f5-4ce8-a0dc-11af5b70e8ad None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:26.130218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afda41d-dea5-4227-9c40-29bdf1c461c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:26.130995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda41d-dea5-4227-9c40-29bdf1c461c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:26.131296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda41d-dea5-4227-9c40-29bdf1c461c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:26.131697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda41d-dea5-4227-9c40-29bdf1c461c7 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef/users/469237a77f874dc09ba8566aad895bfc/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:26.134605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afda41d-dea5-4227-9c40-29bdf1c461c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd7db93d6ee541a491174595f83a43ef, user_id=469237a77f874dc09ba8566aad895bfc, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:26.136495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afda41d-dea5-4227-9c40-29bdf1c461c7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:26.192891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 130/250] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:05:25 2022] PUT /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef/users/469237a77f874dc09ba8566aad895bfc/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:05:26.194339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2421e-b70b-4c0f-9906-3e610ed24afd None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:26.195283 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2421e-b70b-4c0f-9906-3e610ed24afd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:26.195507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2421e-b70b-4c0f-9906-3e610ed24afd None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:26.197434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 131/251] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:26.205083 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971271c3-af45-4020-8cdb-8717f88e1fd8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:26.205440 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971271c3-af45-4020-8cdb-8717f88e1fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:26.205660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971271c3-af45-4020-8cdb-8717f88e1fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:26.227502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c8199-e043-4c1e-97f8-180108ed6d77 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:26.229957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-971271c3-af45-4020-8cdb-8717f88e1fd8 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:26.232477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-971271c3-af45-4020-8cdb-8717f88e1fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:26.275329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b713735-4ab0-4102-aa00-1683194b9141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:26.276230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b713735-4ab0-4102-aa00-1683194b9141 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:26.276644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b713735-4ab0-4102-aa00-1683194b9141 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:26.277048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b713735-4ab0-4102-aa00-1683194b9141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:26.363449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 132/252] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:26.399794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:26.412021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b713735-4ab0-4102-aa00-1683194b9141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:26.413625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b713735-4ab0-4102-aa00-1683194b9141 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:26.544811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 121/253] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:26.553089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971271c3-af45-4020-8cdb-8717f88e1fd8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:26.626903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42960786-aab2-462d-8112-dbda0baf399a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:26.627248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42960786-aab2-462d-8112-dbda0baf399a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:26.627440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42960786-aab2-462d-8112-dbda0baf399a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:26.628933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 122/254] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:05:26.637433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8906-fe89-42a3-88f1-5cc550c796ed None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:26.637433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8906-fe89-42a3-88f1-5cc550c796ed None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:26.637433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8906-fe89-42a3-88f1-5cc550c796ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:26.642027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:26.659559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e30c8906-fe89-42a3-88f1-5cc550c796ed None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:26.661414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e30c8906-fe89-42a3-88f1-5cc550c796ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:26.726982 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971271c3-af45-4020-8cdb-8717f88e1fd8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:26.803324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4924317-3513-4834-b999-5fb7d840fad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:26.804588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4924317-3513-4834-b999-5fb7d840fad1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:26.805306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4924317-3513-4834-b999-5fb7d840fad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:26.806545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4924317-3513-4834-b999-5fb7d840fad1 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:26.808712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4924317-3513-4834-b999-5fb7d840fad1 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:26.812322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4924317-3513-4834-b999-5fb7d840fad1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:26.818152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 133/255] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:26 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:26.818617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 123/256] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:26.825471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4924317-3513-4834-b999-5fb7d840fad1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:26.941999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4924317-3513-4834-b999-5fb7d840fad1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:26.966765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c8906-fe89-42a3-88f1-5cc550c796ed None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:26.979479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:26.987587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ef5f7-536c-44be-918d-c1604c086f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:26.988512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ef5f7-536c-44be-918d-c1604c086f79 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:26.988987 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ef5f7-536c-44be-918d-c1604c086f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:26.989483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ef5f7-536c-44be-918d-c1604c086f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:26.990425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ef5f7-536c-44be-918d-c1604c086f79 None admin] RBAC: Adding query filter params (role.id=fca599016d83441ab8908df85d7fcbbd, scope.project.id=cd7db93d6ee541a491174595f83a43ef, user.id=72a43971412348919a247e06c1828c81) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:26.990729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ef5f7-536c-44be-918d-c1604c086f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:26.992181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ef5f7-536c-44be-918d-c1604c086f79 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:27.008430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 134/257] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:26 2022] GET /identity/v3/role_assignments?user.id=72a43971412348919a247e06c1828c81&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=fca599016d83441ab8908df85d7fcbbd => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:27.029840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:27.120812 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c8906-fe89-42a3-88f1-5cc550c796ed None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:27.168747 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984a08a-a427-4818-838a-11bbe3d24f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:27.169485 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a08a-a427-4818-838a-11bbe3d24f14 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:27.169774 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a08a-a427-4818-838a-11bbe3d24f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:27.170048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a08a-a427-4818-838a-11bbe3d24f14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:27.183057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984a08a-a427-4818-838a-11bbe3d24f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-5984a08a-a427-4818-838a-11bbe3d24f14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:27.188523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:27.192031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:27.194059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 124/258] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:27.201387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ef5f7-536c-44be-918d-c1604c086f79 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:27.311926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ef5f7-536c-44be-918d-c1604c086f79 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:27.348490 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214d0de-2765-47c8-8991-ce7f598571a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:27.349115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214d0de-2765-47c8-8991-ce7f598571a5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:27.349393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214d0de-2765-47c8-8991-ce7f598571a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:27.349841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214d0de-2765-47c8-8991-ce7f598571a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:27.350527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214d0de-2765-47c8-8991-ce7f598571a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:27.350829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214d0de-2765-47c8-8991-ce7f598571a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:27.352341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214d0de-2765-47c8-8991-ce7f598571a5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:27.362309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 135/259] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:27.367971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984a08a-a427-4818-838a-11bbe3d24f14 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:27.384880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214d0de-2765-47c8-8991-ce7f598571a5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:27.491911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:27.534770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214d0de-2765-47c8-8991-ce7f598571a5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:27.555147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984a08a-a427-4818-838a-11bbe3d24f14 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:27.557682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:27.571141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b6b23-76be-4a63-bc0b-6e905a33cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:27.571789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6b23-76be-4a63-bc0b-6e905a33cddf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:27.572383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6b23-76be-4a63-bc0b-6e905a33cddf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:27.572664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6b23-76be-4a63-bc0b-6e905a33cddf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:27.583617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b6b23-76be-4a63-bc0b-6e905a33cddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d78b6b23-76be-4a63-bc0b-6e905a33cddf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:27.588765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:27.589671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:27.590957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 136/260] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:27.596115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b6b23-76be-4a63-bc0b-6e905a33cddf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:27.614428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532ad40-a23e-47f9-802b-bfb8cf42c993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:27.615086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ad40-a23e-47f9-802b-bfb8cf42c993 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:27.615358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ad40-a23e-47f9-802b-bfb8cf42c993 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:27.615624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ad40-a23e-47f9-802b-bfb8cf42c993 None admin] PATH_INFO: `/v3/users/1fa4c84fc21f41bb88cf25c2006ede55` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:27.622761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532ad40-a23e-47f9-802b-bfb8cf42c993 None admin] RBAC: Authorizing `identity:get_user(user_id=1fa4c84fc21f41bb88cf25c2006ede55)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:27.624455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532ad40-a23e-47f9-802b-bfb8cf42c993 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:27.626290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 125/261] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:27 2022] GET /identity/v3/users/1fa4c84fc21f41bb88cf25c2006ede55 => generated 283 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:27.634562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532ad40-a23e-47f9-802b-bfb8cf42c993 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:27.710098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b6b23-76be-4a63-bc0b-6e905a33cddf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:27.728331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:27.746064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfc5d0-5a6c-4b1a-8ef5-c006fdddb293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:27.752094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfc5d0-5a6c-4b1a-8ef5-c006fdddb293 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:27.752094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfc5d0-5a6c-4b1a-8ef5-c006fdddb293 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:27.752094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfc5d0-5a6c-4b1a-8ef5-c006fdddb293 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:27.752094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfc5d0-5a6c-4b1a-8ef5-c006fdddb293 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:27.752094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfc5d0-5a6c-4b1a-8ef5-c006fdddb293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:27.752094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfc5d0-5a6c-4b1a-8ef5-c006fdddb293 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:27.758499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 137/262] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:27.764188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfc5d0-5a6c-4b1a-8ef5-c006fdddb293 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:27.831534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532ad40-a23e-47f9-802b-bfb8cf42c993 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:27.899138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fceea-aef0-468f-b253-e796899e62ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:27.899753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fceea-aef0-468f-b253-e796899e62ab None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:27.900027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fceea-aef0-468f-b253-e796899e62ab None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:27.900293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fceea-aef0-468f-b253-e796899e62ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:27.943633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfc5d0-5a6c-4b1a-8ef5-c006fdddb293 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:27.951217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:28.004799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56edc-6fec-44f1-8cb1-4053d8b0cb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:28.005947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56edc-6fec-44f1-8cb1-4053d8b0cb6b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:28.006461 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56edc-6fec-44f1-8cb1-4053d8b0cb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:28.006987 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56edc-6fec-44f1-8cb1-4053d8b0cb6b None admin] PATH_INFO: `/v3/users/1fa4c84fc21f41bb88cf25c2006ede55` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:28.008171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b56edc-6fec-44f1-8cb1-4053d8b0cb6b None admin] RBAC: Authorizing `identity:get_user(user_id=1fa4c84fc21f41bb88cf25c2006ede55)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:28.010025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b56edc-6fec-44f1-8cb1-4053d8b0cb6b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:28.016396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 138/263] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:27 2022] GET /identity/v3/users/1fa4c84fc21f41bb88cf25c2006ede55 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:28.019200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56edc-6fec-44f1-8cb1-4053d8b0cb6b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:28.021683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fceea-aef0-468f-b253-e796899e62ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:28.023660 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fceea-aef0-468f-b253-e796899e62ab None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:28.119309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:28.179158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56edc-6fec-44f1-8cb1-4053d8b0cb6b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:28.181145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 126/264] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:05:28.192582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fceea-aef0-468f-b253-e796899e62ab None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:28.220379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aea211-8b18-4333-af02-aa5694f2b6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:28.221397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aea211-8b18-4333-af02-aa5694f2b6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:28.221877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aea211-8b18-4333-af02-aa5694f2b6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:28.222343 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aea211-8b18-4333-af02-aa5694f2b6d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:28.284511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:28.315956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aea211-8b18-4333-af02-aa5694f2b6d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:28.317626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aea211-8b18-4333-af02-aa5694f2b6d6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:28.370009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fceea-aef0-468f-b253-e796899e62ab None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:28.416827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:28.442161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51d70-d56e-43c7-88e5-68949cc08fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:28.442803 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51d70-d56e-43c7-88e5-68949cc08fae None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:28.443073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51d70-d56e-43c7-88e5-68949cc08fae None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:28.443339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51d70-d56e-43c7-88e5-68949cc08fae None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:28.444547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc51d70-d56e-43c7-88e5-68949cc08fae None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:28.446022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc51d70-d56e-43c7-88e5-68949cc08fae None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:28.447912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 127/265] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:28 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:28.455967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51d70-d56e-43c7-88e5-68949cc08fae None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:28.518870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 139/266] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:28.524506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aea211-8b18-4333-af02-aa5694f2b6d6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:28.633476 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51d70-d56e-43c7-88e5-68949cc08fae None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:28.673031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aea211-8b18-4333-af02-aa5694f2b6d6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:28.673677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:28.710166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06efacb-7918-4214-bc8b-fda05e3e30ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:28.710810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06efacb-7918-4214-bc8b-fda05e3e30ef None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:28.711084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06efacb-7918-4214-bc8b-fda05e3e30ef None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:28.711418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06efacb-7918-4214-bc8b-fda05e3e30ef None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:28.712889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06efacb-7918-4214-bc8b-fda05e3e30ef None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:28.714383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06efacb-7918-4214-bc8b-fda05e3e30ef None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:28.717103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 140/267] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:28 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:28.721727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084ca12-0ae5-4eae-a039-4814eb75e610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:28.722339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ca12-0ae5-4eae-a039-4814eb75e610 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:28.722616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ca12-0ae5-4eae-a039-4814eb75e610 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:28.722886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ca12-0ae5-4eae-a039-4814eb75e610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:28.723614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084ca12-0ae5-4eae-a039-4814eb75e610 None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=cd7db93d6ee541a491174595f83a43ef, user.id=1fa4c84fc21f41bb88cf25c2006ede55) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:28.723917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084ca12-0ae5-4eae-a039-4814eb75e610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:28.725350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084ca12-0ae5-4eae-a039-4814eb75e610 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:28.730285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06efacb-7918-4214-bc8b-fda05e3e30ef None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:28.736502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 128/268] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:28 2022] GET /identity/v3/role_assignments?user.id=1fa4c84fc21f41bb88cf25c2006ede55&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=28beda93f70d4c549352145ddee01aac => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:28.751398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f543-b17f-43bc-a363-55813c590f0a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:28.751747 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f543-b17f-43bc-a363-55813c590f0a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:28.752032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f543-b17f-43bc-a363-55813c590f0a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:28.757740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 129/269] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:28.759142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30313550-85e0-4a7d-89bf-a8d4bfb6cf78 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:28.759424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30313550-85e0-4a7d-89bf-a8d4bfb6cf78 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:28.759695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30313550-85e0-4a7d-89bf-a8d4bfb6cf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:28.767917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:28.794676 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-30313550-85e0-4a7d-89bf-a8d4bfb6cf78 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:28.795993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-30313550-85e0-4a7d-89bf-a8d4bfb6cf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:28.863618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06efacb-7918-4214-bc8b-fda05e3e30ef None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:28.905384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb94cb-54d1-49cb-acfd-241ca05a1559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:28.905553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb94cb-54d1-49cb-acfd-241ca05a1559 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:28.905714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb94cb-54d1-49cb-acfd-241ca05a1559 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:28.905985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb94cb-54d1-49cb-acfd-241ca05a1559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:28.906780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb94cb-54d1-49cb-acfd-241ca05a1559 None admin] RBAC: Adding query filter params (role.id=68da777efbc34e15a79e851577a8ee89, scope.project.id=cd7db93d6ee541a491174595f83a43ef, user.id=1fa4c84fc21f41bb88cf25c2006ede55) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:28.907085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb94cb-54d1-49cb-acfd-241ca05a1559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:28.908622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb94cb-54d1-49cb-acfd-241ca05a1559 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:28.916802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 141/270] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:28 2022] GET /identity/v3/role_assignments?user.id=1fa4c84fc21f41bb88cf25c2006ede55&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=68da777efbc34e15a79e851577a8ee89 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:29.000072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 130/271] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:29.043617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac36ba-55d4-485b-81b8-e497c3c740b9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.043866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac36ba-55d4-485b-81b8-e497c3c740b9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.044144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac36ba-55d4-485b-81b8-e497c3c740b9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.045548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 142/272] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:29.051149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad25cec-25ea-423e-ad7e-1eec14e6ebd5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.051637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad25cec-25ea-423e-ad7e-1eec14e6ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.051878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad25cec-25ea-423e-ad7e-1eec14e6ebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.070913 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9ad25cec-25ea-423e-ad7e-1eec14e6ebd5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:29.072369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9ad25cec-25ea-423e-ad7e-1eec14e6ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:29.145403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 131/273] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:29.349016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac36ba-55d4-485b-81b8-e497c3c740b9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:29.439557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad25cec-25ea-423e-ad7e-1eec14e6ebd5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:29.454715 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:29.488146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac36ba-55d4-485b-81b8-e497c3c740b9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:29.523356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:29.534417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13caa64-88af-4866-bb94-82dacc080fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:29.535454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13caa64-88af-4866-bb94-82dacc080fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.535896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13caa64-88af-4866-bb94-82dacc080fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.536325 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13caa64-88af-4866-bb94-82dacc080fc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.547983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13caa64-88af-4866-bb94-82dacc080fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f13caa64-88af-4866-bb94-82dacc080fc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:29.553305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:29.554209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:29.554990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:29.557285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 143/274] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:29.563805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13caa64-88af-4866-bb94-82dacc080fc0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:29.593939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad25cec-25ea-423e-ad7e-1eec14e6ebd5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:29.638179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c7d40-a738-404d-93db-36bb97e275c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:29.639171 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c7d40-a738-404d-93db-36bb97e275c8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.639513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c7d40-a738-404d-93db-36bb97e275c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.639851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c7d40-a738-404d-93db-36bb97e275c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.641028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c7d40-a738-404d-93db-36bb97e275c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:29.643220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c7d40-a738-404d-93db-36bb97e275c8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:29.645157 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 132/275] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:29.651588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c7d40-a738-404d-93db-36bb97e275c8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:29.683146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13caa64-88af-4866-bb94-82dacc080fc0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:29.727935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720ec01-664c-4c90-9be8-92bc02b2a5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:29.729224 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ec01-664c-4c90-9be8-92bc02b2a5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.729671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ec01-664c-4c90-9be8-92bc02b2a5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.730086 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720ec01-664c-4c90-9be8-92bc02b2a5a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.731587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720ec01-664c-4c90-9be8-92bc02b2a5a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:29.732061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720ec01-664c-4c90-9be8-92bc02b2a5a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:29.734215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720ec01-664c-4c90-9be8-92bc02b2a5a7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:29.748252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 144/276] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:29.748252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737e672-e94c-492d-8036-28d5f704c126 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.748252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737e672-e94c-492d-8036-28d5f704c126 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.748252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737e672-e94c-492d-8036-28d5f704c126 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.748252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 145/277] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:29.752403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737e672-e94c-492d-8036-28d5f704c126 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:29.755377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:29.774830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c7d40-a738-404d-93db-36bb97e275c8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:29.789262 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:29.811329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064e506-5df8-4522-b88c-46686e3f8647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:29.811940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064e506-5df8-4522-b88c-46686e3f8647 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064e506-5df8-4522-b88c-46686e3f8647 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.812571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064e506-5df8-4522-b88c-46686e3f8647 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.813429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064e506-5df8-4522-b88c-46686e3f8647 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:29.815148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064e506-5df8-4522-b88c-46686e3f8647 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:29.862154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737e672-e94c-492d-8036-28d5f704c126 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:29.899077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81972b36-9007-44e6-9a54-31230a7a773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:29.899077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81972b36-9007-44e6-9a54-31230a7a773b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.899077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81972b36-9007-44e6-9a54-31230a7a773b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.899077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81972b36-9007-44e6-9a54-31230a7a773b None admin] PATH_INFO: `/v3/users/d581f04cfa034cc398aa0cc13239ecbd` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.912936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81972b36-9007-44e6-9a54-31230a7a773b None admin] RBAC: Authorizing `identity:get_user(user_id=d581f04cfa034cc398aa0cc13239ecbd)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:29.914525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81972b36-9007-44e6-9a54-31230a7a773b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:29.924951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 146/278] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:29 2022] GET /identity/v3/users/d581f04cfa034cc398aa0cc13239ecbd => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:29.925152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 133/279] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:29 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:05:29.927856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a6227-94f5-484b-945e-5481e6127ffe None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.927856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a6227-94f5-484b-945e-5481e6127ffe None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.927856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a6227-94f5-484b-945e-5481e6127ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.929837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67851b7c-f347-4a55-b831-91e91b117805 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.930358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67851b7c-f347-4a55-b831-91e91b117805 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.930831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67851b7c-f347-4a55-b831-91e91b117805 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.932447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 134/280] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:29.933480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67851b7c-f347-4a55-b831-91e91b117805 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:29.942577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a75a6227-94f5-484b-945e-5481e6127ffe None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:29.943855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a75a6227-94f5-484b-945e-5481e6127ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:30.009697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:30.021622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 147/281] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:30.022900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dc736-9b2f-4c49-9d90-e3ae00a98c7b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:30.023207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dc736-9b2f-4c49-9d90-e3ae00a98c7b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:30.023481 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dc736-9b2f-4c49-9d90-e3ae00a98c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:30.044267 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2c9dc736-9b2f-4c49-9d90-e3ae00a98c7b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:30.045712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2c9dc736-9b2f-4c49-9d90-e3ae00a98c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:30.075469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67851b7c-f347-4a55-b831-91e91b117805 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:30.114329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bb02d-6f91-4d88-b91b-0b12c76dbafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:30.115081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb02d-6f91-4d88-b91b-0b12c76dbafb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:30.115460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb02d-6f91-4d88-b91b-0b12c76dbafb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:30.115827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb02d-6f91-4d88-b91b-0b12c76dbafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:30.116670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bb02d-6f91-4d88-b91b-0b12c76dbafb None admin] RBAC: Adding query filter params (role.id=a64cd92139fb4f1fb64f05f5a88f999f, user.id=d581f04cfa034cc398aa0cc13239ecbd, scope.system=all) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:30.117074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bb02d-6f91-4d88-b91b-0b12c76dbafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:30.118588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bb02d-6f91-4d88-b91b-0b12c76dbafb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:30.124006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 135/282] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 17 16:05:29 2022] GET /identity/v3/role_assignments?user.id=d581f04cfa034cc398aa0cc13239ecbd&scope.system=all&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:30.126599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 148/283] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:30.313826 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bb02d-6f91-4d88-b91b-0b12c76dbafb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:30.349324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:30.405727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dc736-9b2f-4c49-9d90-e3ae00a98c7b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:30.461769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bb02d-6f91-4d88-b91b-0b12c76dbafb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:30.530109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de4bba-f9c8-4251-9dde-d93b2b41b2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:30.530750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de4bba-f9c8-4251-9dde-d93b2b41b2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:30.531024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de4bba-f9c8-4251-9dde-d93b2b41b2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:30.531291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de4bba-f9c8-4251-9dde-d93b2b41b2b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:30.550537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de4bba-f9c8-4251-9dde-d93b2b41b2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f1de4bba-f9c8-4251-9dde-d93b2b41b2b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:30.556766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:30.557662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:30.558475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:30.562120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 136/284] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:30.566541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de4bba-f9c8-4251-9dde-d93b2b41b2b9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:30.585118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dc736-9b2f-4c49-9d90-e3ae00a98c7b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:30.621935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:30.651497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735830a9-a7bd-4470-aead-8fc5bb5f3dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:30.652150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735830a9-a7bd-4470-aead-8fc5bb5f3dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:30.652473 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735830a9-a7bd-4470-aead-8fc5bb5f3dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:30.657781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735830a9-a7bd-4470-aead-8fc5bb5f3dc1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:30.667824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:30.677501 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de4bba-f9c8-4251-9dde-d93b2b41b2b9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:30.679638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735830a9-a7bd-4470-aead-8fc5bb5f3dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-735830a9-a7bd-4470-aead-8fc5bb5f3dc1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:30.685013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:30.688883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:30.689700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:30.693845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 149/285] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:30.707184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735830a9-a7bd-4470-aead-8fc5bb5f3dc1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:30.725514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001100e-3a71-4a13-9f81-c060ba66fff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:30.726186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001100e-3a71-4a13-9f81-c060ba66fff4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:30.726463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001100e-3a71-4a13-9f81-c060ba66fff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:30.726733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001100e-3a71-4a13-9f81-c060ba66fff4 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:30.727509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001100e-3a71-4a13-9f81-c060ba66fff4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:30.727810 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001100e-3a71-4a13-9f81-c060ba66fff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:30.731244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001100e-3a71-4a13-9f81-c060ba66fff4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:30.746237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 137/286] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:30.755622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001100e-3a71-4a13-9f81-c060ba66fff4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:30.895230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001100e-3a71-4a13-9f81-c060ba66fff4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:30.918612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735830a9-a7bd-4470-aead-8fc5bb5f3dc1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:30.930163 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347b028-3f0f-4f9f-849b-07bc97f57ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:30.930810 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347b028-3f0f-4f9f-849b-07bc97f57ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:30.931088 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347b028-3f0f-4f9f-849b-07bc97f57ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:30.931362 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347b028-3f0f-4f9f-849b-07bc97f57ca1 None admin] PATH_INFO: `/v3/users/469237a77f874dc09ba8566aad895bfc` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:30.936830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347b028-3f0f-4f9f-849b-07bc97f57ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=469237a77f874dc09ba8566aad895bfc)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:30.938313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347b028-3f0f-4f9f-849b-07bc97f57ca1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:30.941308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 138/287] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:30 2022] GET /identity/v3/users/469237a77f874dc09ba8566aad895bfc => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:30.947194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347b028-3f0f-4f9f-849b-07bc97f57ca1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:30.979941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda99e93-c483-464a-ba0d-a3d7f8cdbc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:30.981137 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda99e93-c483-464a-ba0d-a3d7f8cdbc81 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:30.981546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda99e93-c483-464a-ba0d-a3d7f8cdbc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:30.981828 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda99e93-c483-464a-ba0d-a3d7f8cdbc81 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:30.982502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda99e93-c483-464a-ba0d-a3d7f8cdbc81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:30.982855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda99e93-c483-464a-ba0d-a3d7f8cdbc81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:30.984303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda99e93-c483-464a-ba0d-a3d7f8cdbc81 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:30.988390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:30.995173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 150/288] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:31.006044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda99e93-c483-464a-ba0d-a3d7f8cdbc81 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:31.088021 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:31.128233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347b028-3f0f-4f9f-849b-07bc97f57ca1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:31.197843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda99e93-c483-464a-ba0d-a3d7f8cdbc81 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:31.203077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f46cf-d96d-47a7-85b4-08d26dd1a5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:31.203708 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f46cf-d96d-47a7-85b4-08d26dd1a5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:31.203989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f46cf-d96d-47a7-85b4-08d26dd1a5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:31.204263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f46cf-d96d-47a7-85b4-08d26dd1a5b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:31.240126 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b44c5-dc21-4a7c-94e6-7797b861aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:31.241886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b44c5-dc21-4a7c-94e6-7797b861aa61 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:31.245070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b44c5-dc21-4a7c-94e6-7797b861aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:31.245584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b44c5-dc21-4a7c-94e6-7797b861aa61 None admin] PATH_INFO: `/v3/users/72a43971412348919a247e06c1828c81` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:31.248681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b44c5-dc21-4a7c-94e6-7797b861aa61 None admin] RBAC: Authorizing `identity:get_user(user_id=72a43971412348919a247e06c1828c81)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:31.250394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b44c5-dc21-4a7c-94e6-7797b861aa61 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:31.252360 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 151/289] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:31 2022] GET /identity/v3/users/72a43971412348919a247e06c1828c81 => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:31.257946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b44c5-dc21-4a7c-94e6-7797b861aa61 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:31.325010 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f46cf-d96d-47a7-85b4-08d26dd1a5b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:31.326978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f46cf-d96d-47a7-85b4-08d26dd1a5b6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:31.359853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:31.434427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b44c5-dc21-4a7c-94e6-7797b861aa61 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:31.469206 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:31.478550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa2acd-15a3-4323-abea-613d47e828c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:31.484315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa2acd-15a3-4323-abea-613d47e828c8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:31.484315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa2acd-15a3-4323-abea-613d47e828c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:31.484315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa2acd-15a3-4323-abea-613d47e828c8 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:31.484315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa2acd-15a3-4323-abea-613d47e828c8 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:31.484315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa2acd-15a3-4323-abea-613d47e828c8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:31.486611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 152/290] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:31 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:31.493205 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa2acd-15a3-4323-abea-613d47e828c8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:31.520415 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 139/291] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:05:31.526131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f46cf-d96d-47a7-85b4-08d26dd1a5b6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:31.681211 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa2acd-15a3-4323-abea-613d47e828c8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:31.722081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f46cf-d96d-47a7-85b4-08d26dd1a5b6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:31.749344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d3dbd-e6ec-49dd-9c92-6f96bf0796cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:31.750039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d3dbd-e6ec-49dd-9c92-6f96bf0796cb None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:31.750316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d3dbd-e6ec-49dd-9c92-6f96bf0796cb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:31.750589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d3dbd-e6ec-49dd-9c92-6f96bf0796cb None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef/users/72a43971412348919a247e06c1828c81/roles/fca599016d83441ab8908df85d7fcbbd` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:31.756175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d3dbd-e6ec-49dd-9c92-6f96bf0796cb None admin] RBAC: Authorizing `identity:create_grant(project_id=cd7db93d6ee541a491174595f83a43ef, user_id=72a43971412348919a247e06c1828c81, role_id=fca599016d83441ab8908df85d7fcbbd)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:31.757656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d3dbd-e6ec-49dd-9c92-6f96bf0796cb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:31.762382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:31.778088 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa9053-c353-4e6f-b7a8-0d889061c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:31.778724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa9053-c353-4e6f-b7a8-0d889061c731 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:31.779002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa9053-c353-4e6f-b7a8-0d889061c731 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:31.779272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa9053-c353-4e6f-b7a8-0d889061c731 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:31.780481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa9053-c353-4e6f-b7a8-0d889061c731 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:31.782100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa9053-c353-4e6f-b7a8-0d889061c731 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:31.794508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 140/292] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:31 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:31.794508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa9053-c353-4e6f-b7a8-0d889061c731 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:31.871814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 153/293] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:05:31 2022] PUT /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef/users/72a43971412348919a247e06c1828c81/roles/fca599016d83441ab8908df85d7fcbbd => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:31.921317 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa9053-c353-4e6f-b7a8-0d889061c731 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:31.970699 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67858a8-0437-4b28-98f9-5187194366ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:31.971732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67858a8-0437-4b28-98f9-5187194366ec None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:31.972225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67858a8-0437-4b28-98f9-5187194366ec None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:31.972644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67858a8-0437-4b28-98f9-5187194366ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:31.973568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67858a8-0437-4b28-98f9-5187194366ec None admin] RBAC: Adding query filter params (role.id=a64cd92139fb4f1fb64f05f5a88f999f, scope.project.id=cd7db93d6ee541a491174595f83a43ef, user.id=469237a77f874dc09ba8566aad895bfc) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:31.974094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67858a8-0437-4b28-98f9-5187194366ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:31.975724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67858a8-0437-4b28-98f9-5187194366ec None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:31.986808 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 141/294] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:31 2022] GET /identity/v3/role_assignments?user.id=469237a77f874dc09ba8566aad895bfc&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:32.286418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f32f7-a5fa-4ada-a2d7-cefa7c2d3441 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:32.286902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f32f7-a5fa-4ada-a2d7-cefa7c2d3441 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:32.286902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f32f7-a5fa-4ada-a2d7-cefa7c2d3441 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:32.288227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 154/295] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:32.294393 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7192d5b-2078-4740-803b-5d7cdb5ba5c2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:32.295268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7192d5b-2078-4740-803b-5d7cdb5ba5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:32.295755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7192d5b-2078-4740-803b-5d7cdb5ba5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:32.318281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a7192d5b-2078-4740-803b-5d7cdb5ba5c2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:32.319816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a7192d5b-2078-4740-803b-5d7cdb5ba5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:32.379713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:32.399582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 142/296] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:32.425792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab72e8e-d7d7-474c-9803-44403673fc67 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:32.426091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab72e8e-d7d7-474c-9803-44403673fc67 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:32.426349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab72e8e-d7d7-474c-9803-44403673fc67 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:32.427696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 155/297] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:32.433020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38214f-6b59-4e51-9d1b-52f3caeda871 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:32.434244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38214f-6b59-4e51-9d1b-52f3caeda871 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:32.434799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38214f-6b59-4e51-9d1b-52f3caeda871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:32.441792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989598-8b5e-4190-81b1-35800bcd77aa None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:32.442076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989598-8b5e-4190-81b1-35800bcd77aa None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:32.442356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989598-8b5e-4190-81b1-35800bcd77aa None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:32.443684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 156/298] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:05:32.449028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49cba0-2ded-46f3-856a-5d3459968f65 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:32.449966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49cba0-2ded-46f3-856a-5d3459968f65 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:32.450465 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49cba0-2ded-46f3-856a-5d3459968f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:32.462596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ff38214f-6b59-4e51-9d1b-52f3caeda871 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:32.464223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ff38214f-6b59-4e51-9d1b-52f3caeda871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:32.470546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3e49cba0-2ded-46f3-856a-5d3459968f65 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:32.470786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3e49cba0-2ded-46f3-856a-5d3459968f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:32.502794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:32.548778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 157/299] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:32.563641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 143/300] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:32.687434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49cba0-2ded-46f3-856a-5d3459968f65 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:32.786411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49cba0-2ded-46f3-856a-5d3459968f65 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:32.821938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e028e-592a-41a0-87ba-4b6c648e87ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:32.822853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e028e-592a-41a0-87ba-4b6c648e87ae None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:32.823344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e028e-592a-41a0-87ba-4b6c648e87ae None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:32.823817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e028e-592a-41a0-87ba-4b6c648e87ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:32.834123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e028e-592a-41a0-87ba-4b6c648e87ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:32.836203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38214f-6b59-4e51-9d1b-52f3caeda871 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-bb3e028e-592a-41a0-87ba-4b6c648e87ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:32.840860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:32.841784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:32.842562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:32.844821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 158/301] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:32.851124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e028e-592a-41a0-87ba-4b6c648e87ae None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:32.886402 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:32.950881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38214f-6b59-4e51-9d1b-52f3caeda871 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:32.969198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:32.970127 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e028e-592a-41a0-87ba-4b6c648e87ae None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:32.990130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cf5f5-da82-4e6b-8aea-958da1dc5897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:32.990778 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cf5f5-da82-4e6b-8aea-958da1dc5897 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:32.991203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cf5f5-da82-4e6b-8aea-958da1dc5897 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:32.991724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cf5f5-da82-4e6b-8aea-958da1dc5897 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:32.992831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3cf5f5-da82-4e6b-8aea-958da1dc5897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:32.994308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3cf5f5-da82-4e6b-8aea-958da1dc5897 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:32.995909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 144/302] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:32.997059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cf5f5-da82-4e6b-8aea-958da1dc5897 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:33.036054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b5ba-a3be-4673-8c98-b21de7f93a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:33.036717 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b5ba-a3be-4673-8c98-b21de7f93a51 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:33.036991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b5ba-a3be-4673-8c98-b21de7f93a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:33.037279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b5ba-a3be-4673-8c98-b21de7f93a51 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.037965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24b5ba-a3be-4673-8c98-b21de7f93a51 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:33.038262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24b5ba-a3be-4673-8c98-b21de7f93a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:33.039633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24b5ba-a3be-4673-8c98-b21de7f93a51 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:33.048916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 159/303] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:33.054136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b5ba-a3be-4673-8c98-b21de7f93a51 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:33.107713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cf5f5-da82-4e6b-8aea-958da1dc5897 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:33.147245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c2cb2-6568-4721-a894-a38829770fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:33.148830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2cb2-6568-4721-a894-a38829770fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:33.149614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2cb2-6568-4721-a894-a38829770fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:33.150054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2cb2-6568-4721-a894-a38829770fc7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.151012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:33.160931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b5ba-a3be-4673-8c98-b21de7f93a51 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:33.163174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c2cb2-6568-4721-a894-a38829770fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-e25c2cb2-6568-4721-a894-a38829770fc7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:33.168223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:33.169509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:33.170495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:33.172422 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 145/304] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:33.173483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c2cb2-6568-4721-a894-a38829770fc7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:33.200030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06e9c-01b4-43ca-8d72-7e4866811689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:33.200729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06e9c-01b4-43ca-8d72-7e4866811689 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:33.201008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06e9c-01b4-43ca-8d72-7e4866811689 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:33.201277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06e9c-01b4-43ca-8d72-7e4866811689 None admin] PATH_INFO: `/v3/groups` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.201934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c06e9c-01b4-43ca-8d72-7e4866811689 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:33.203364 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c06e9c-01b4-43ca-8d72-7e4866811689 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:33.221992 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:33.266134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 160/305] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Aug 17 16:05:33 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:33.267543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06e9c-01b4-43ca-8d72-7e4866811689 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:33.280722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c2cb2-6568-4721-a894-a38829770fc7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:33.321507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc9fa9-8a6c-41eb-b6da-f88db458a9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:33.323248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc9fa9-8a6c-41eb-b6da-f88db458a9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:33.323524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc9fa9-8a6c-41eb-b6da-f88db458a9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:33.323847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc9fa9-8a6c-41eb-b6da-f88db458a9f1 None admin] PATH_INFO: `/v3/users/d581f04cfa034cc398aa0cc13239ecbd` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.326084 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc9fa9-8a6c-41eb-b6da-f88db458a9f1 None admin] RBAC: Authorizing `identity:get_user(user_id=d581f04cfa034cc398aa0cc13239ecbd)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:33.327639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc9fa9-8a6c-41eb-b6da-f88db458a9f1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:33.329770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 146/306] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:33 2022] GET /identity/v3/users/d581f04cfa034cc398aa0cc13239ecbd => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:33.338541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc9fa9-8a6c-41eb-b6da-f88db458a9f1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:33.424575 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06e9c-01b4-43ca-8d72-7e4866811689 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:33.467332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcac48-3ec3-47ae-b59b-b6284e5572e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:33.468205 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcac48-3ec3-47ae-b59b-b6284e5572e5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:33.468486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcac48-3ec3-47ae-b59b-b6284e5572e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:33.468758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcac48-3ec3-47ae-b59b-b6284e5572e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.468880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc9fa9-8a6c-41eb-b6da-f88db458a9f1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:33.469463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcac48-3ec3-47ae-b59b-b6284e5572e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:33.469765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcac48-3ec3-47ae-b59b-b6284e5572e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:33.471409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcac48-3ec3-47ae-b59b-b6284e5572e5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:33.482517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 161/307] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:33.483172 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:33.488999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcac48-3ec3-47ae-b59b-b6284e5572e5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:33.508758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:33.522431 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed1079-14ee-4a1a-b260-d8a1d4f51981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:33.523719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed1079-14ee-4a1a-b260-d8a1d4f51981 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:33.524402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed1079-14ee-4a1a-b260-d8a1d4f51981 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:33.525194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed1079-14ee-4a1a-b260-d8a1d4f51981 None admin] PATH_INFO: `/v3/system/users/d581f04cfa034cc398aa0cc13239ecbd/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.527854 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed1079-14ee-4a1a-b260-d8a1d4f51981 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d581f04cfa034cc398aa0cc13239ecbd, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:33.530794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed1079-14ee-4a1a-b260-d8a1d4f51981 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:33.599586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcac48-3ec3-47ae-b59b-b6284e5572e5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:33.619565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 147/308] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Aug 17 16:05:33 2022] PUT /identity/v3/system/users/d581f04cfa034cc398aa0cc13239ecbd/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:33.639644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856e21e-4d39-413e-9287-4e541a54fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:33.640767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856e21e-4d39-413e-9287-4e541a54fe7c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:33.641253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856e21e-4d39-413e-9287-4e541a54fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:33.641805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856e21e-4d39-413e-9287-4e541a54fe7c None admin] PATH_INFO: `/v3/users/85f93b553cc4437e92c00db4d9aed3d6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.660200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856e21e-4d39-413e-9287-4e541a54fe7c None admin] RBAC: Authorizing `identity:get_user(user_id=85f93b553cc4437e92c00db4d9aed3d6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:33.662245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856e21e-4d39-413e-9287-4e541a54fe7c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:33.664742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 162/309] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:33 2022] GET /identity/v3/users/85f93b553cc4437e92c00db4d9aed3d6 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:33.671271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed1079-14ee-4a1a-b260-d8a1d4f51981 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:33.793752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed1079-14ee-4a1a-b260-d8a1d4f51981 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:33.830684 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adfa77-aa03-4c2b-85a3-975f3af0867f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:33.831648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adfa77-aa03-4c2b-85a3-975f3af0867f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:33.832130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adfa77-aa03-4c2b-85a3-975f3af0867f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:33.832625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adfa77-aa03-4c2b-85a3-975f3af0867f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.833583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adfa77-aa03-4c2b-85a3-975f3af0867f None admin] RBAC: Adding query filter params (role.id=fca599016d83441ab8908df85d7fcbbd, user.id=85f93b553cc4437e92c00db4d9aed3d6, scope.system=all) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:33.834110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adfa77-aa03-4c2b-85a3-975f3af0867f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:33.835762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adfa77-aa03-4c2b-85a3-975f3af0867f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:33.842381 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 148/310] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 17 16:05:33 2022] GET /identity/v3/role_assignments?user.id=85f93b553cc4437e92c00db4d9aed3d6&scope.system=all&role.id=fca599016d83441ab8908df85d7fcbbd => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:34.008587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276bd25-7bb4-487d-b606-41d5470c7b78 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:34.008929 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276bd25-7bb4-487d-b606-41d5470c7b78 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:34.009147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276bd25-7bb4-487d-b606-41d5470c7b78 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:34.010676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 163/311] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:34.015925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63793-08c4-4642-8649-27dbc50d37df None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:34.016218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63793-08c4-4642-8649-27dbc50d37df None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:34.016495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63793-08c4-4642-8649-27dbc50d37df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:34.069786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-56c63793-08c4-4642-8649-27dbc50d37df None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:34.070932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-56c63793-08c4-4642-8649-27dbc50d37df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:34.104512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:34.145198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 149/312] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:34.415352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276bd25-7bb4-487d-b606-41d5470c7b78 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:34.495550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:34.532521 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276bd25-7bb4-487d-b606-41d5470c7b78 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:34.568530 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac5f90-54a6-4176-afb3-25cfc4cfe14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:34.569220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac5f90-54a6-4176-afb3-25cfc4cfe14b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:34.569536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac5f90-54a6-4176-afb3-25cfc4cfe14b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:34.569813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac5f90-54a6-4176-afb3-25cfc4cfe14b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:34.581496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac5f90-54a6-4176-afb3-25cfc4cfe14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a4ac5f90-54a6-4176-afb3-25cfc4cfe14b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:34.586255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:34.587122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:34.588645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 164/313] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:34.593671 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c63793-08c4-4642-8649-27dbc50d37df None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:34.700205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c63793-08c4-4642-8649-27dbc50d37df None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:34.745389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5c99e-630f-4464-b118-6644c601fec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:34.745389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5c99e-630f-4464-b118-6644c601fec5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:34.745389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5c99e-630f-4464-b118-6644c601fec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:34.745389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5c99e-630f-4464-b118-6644c601fec5 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:34.746714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5c99e-630f-4464-b118-6644c601fec5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:34.746714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5c99e-630f-4464-b118-6644c601fec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:34.746714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5c99e-630f-4464-b118-6644c601fec5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:34.756412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 150/314] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:34.762191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac5f90-54a6-4176-afb3-25cfc4cfe14b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:34.872974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac5f90-54a6-4176-afb3-25cfc4cfe14b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:34.908114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:34.910010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6812c0-761e-48b5-a901-9176f34b6f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:34.910656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6812c0-761e-48b5-a901-9176f34b6f8d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:34.910936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6812c0-761e-48b5-a901-9176f34b6f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:34.911235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6812c0-761e-48b5-a901-9176f34b6f8d None admin] PATH_INFO: `/v3/users/72a43971412348919a247e06c1828c81` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:34.912456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6812c0-761e-48b5-a901-9176f34b6f8d None admin] RBAC: Authorizing `identity:get_user(user_id=72a43971412348919a247e06c1828c81)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:34.914001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6812c0-761e-48b5-a901-9176f34b6f8d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:34.915892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 165/315] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:34 2022] GET /identity/v3/users/72a43971412348919a247e06c1828c81 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:34.922720 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5c99e-630f-4464-b118-6644c601fec5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:34.958234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:35.033970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5c99e-630f-4464-b118-6644c601fec5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:35.071862 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7a577-ea66-406e-a91e-c25b4ba0df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:35.072485 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7a577-ea66-406e-a91e-c25b4ba0df87 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.072764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7a577-ea66-406e-a91e-c25b4ba0df87 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.073039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7a577-ea66-406e-a91e-c25b4ba0df87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.149554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7a577-ea66-406e-a91e-c25b4ba0df87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:35.151398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7a577-ea66-406e-a91e-c25b4ba0df87 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:35.182185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:35.255820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 151/316] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:35.261357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6812c0-761e-48b5-a901-9176f34b6f8d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:35.377756 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6812c0-761e-48b5-a901-9176f34b6f8d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:35.386245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404824a3-a7cc-4809-a36b-f02d335834aa None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.386563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404824a3-a7cc-4809-a36b-f02d335834aa None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.386842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404824a3-a7cc-4809-a36b-f02d335834aa None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.388202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 152/317] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:05:35.393167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8417b4-3a36-4666-948d-66dc722d18f2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.393483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8417b4-3a36-4666-948d-66dc722d18f2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.393760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8417b4-3a36-4666-948d-66dc722d18f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.414200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9b8417b4-3a36-4666-948d-66dc722d18f2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:35.415363 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9b8417b4-3a36-4666-948d-66dc722d18f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:35.416632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb3ba-96bc-4bfc-8866-0c0e91fd7c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:35.417498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb3ba-96bc-4bfc-8866-0c0e91fd7c98 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.418800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb3ba-96bc-4bfc-8866-0c0e91fd7c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.419260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfb3ba-96bc-4bfc-8866-0c0e91fd7c98 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.420468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfb3ba-96bc-4bfc-8866-0c0e91fd7c98 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:35.421987 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfb3ba-96bc-4bfc-8866-0c0e91fd7c98 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:35.423629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 166/318] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:35 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:35.429471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb3ba-96bc-4bfc-8866-0c0e91fd7c98 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:35.501493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:35.506374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 153/319] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:35.545692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfb3ba-96bc-4bfc-8866-0c0e91fd7c98 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:35.586039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1eaab-110f-46c7-a1be-a32f1294074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:35.586977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1eaab-110f-46c7-a1be-a32f1294074a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.587447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1eaab-110f-46c7-a1be-a32f1294074a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.587938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1eaab-110f-46c7-a1be-a32f1294074a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.588850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1eaab-110f-46c7-a1be-a32f1294074a None admin] RBAC: Adding query filter params (role.id=fca599016d83441ab8908df85d7fcbbd, scope.project.id=cd7db93d6ee541a491174595f83a43ef, user.id=72a43971412348919a247e06c1828c81) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:35.589344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1eaab-110f-46c7-a1be-a32f1294074a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:35.591687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1eaab-110f-46c7-a1be-a32f1294074a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:35.598305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 167/320] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:35 2022] GET /identity/v3/role_assignments?user.id=72a43971412348919a247e06c1828c81&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=fca599016d83441ab8908df85d7fcbbd => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:35.722571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658ebd4-06c7-4fdd-ba1b-dfe81a91507d None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.723087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658ebd4-06c7-4fdd-ba1b-dfe81a91507d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.723160 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658ebd4-06c7-4fdd-ba1b-dfe81a91507d None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.724842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 154/321] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:35.730407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b50f31-cb5c-4f04-b6bb-dc0e61907986 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.730934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b50f31-cb5c-4f04-b6bb-dc0e61907986 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.731212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b50f31-cb5c-4f04-b6bb-dc0e61907986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.749769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-04b50f31-cb5c-4f04-b6bb-dc0e61907986 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:35.750949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-04b50f31-cb5c-4f04-b6bb-dc0e61907986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:35.770173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24190ce1-5b4c-4b7e-b146-fc1f911e067f None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.770430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24190ce1-5b4c-4b7e-b146-fc1f911e067f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.770632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24190ce1-5b4c-4b7e-b146-fc1f911e067f None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.771960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 155/322] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:35.779442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dff06-de52-42f3-844a-9b40e81d0159 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.779723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dff06-de52-42f3-844a-9b40e81d0159 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.779993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dff06-de52-42f3-844a-9b40e81d0159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.800572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7d9dff06-de52-42f3-844a-9b40e81d0159 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:35.801790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7d9dff06-de52-42f3-844a-9b40e81d0159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:35.831649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 168/323] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:35.832537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b50f31-cb5c-4f04-b6bb-dc0e61907986 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:35.872114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:35.889436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 156/324] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:35.904924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:35.946003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b50f31-cb5c-4f04-b6bb-dc0e61907986 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:35.981112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1cf1-d042-4827-a57c-b26309768f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:35.981773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1cf1-d042-4827-a57c-b26309768f4e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.982053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1cf1-d042-4827-a57c-b26309768f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.982322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1cf1-d042-4827-a57c-b26309768f4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.983425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b1cf1-d042-4827-a57c-b26309768f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:35.984867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b1cf1-d042-4827-a57c-b26309768f4e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:35.986623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 169/325] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:35.991979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9dff06-de52-42f3-844a-9b40e81d0159 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:36.103745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1cf1-d042-4827-a57c-b26309768f4e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:36.114812 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9dff06-de52-42f3-844a-9b40e81d0159 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:36.150778 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd370f0-9ffe-4706-8cd8-edf99d836eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:36.151372 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd370f0-9ffe-4706-8cd8-edf99d836eac None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:36.151713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd370f0-9ffe-4706-8cd8-edf99d836eac None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:36.152107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd370f0-9ffe-4706-8cd8-edf99d836eac None admin] PATH_INFO: `/v3/groups` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:36.152852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd370f0-9ffe-4706-8cd8-edf99d836eac None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:36.154583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd370f0-9ffe-4706-8cd8-edf99d836eac None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:36.203433 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1cf1-d042-4827-a57c-b26309768f4e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:36.234317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:36.241696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242154a2-8170-4fc3-bcba-3c122ad7c7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:36.242298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242154a2-8170-4fc3-bcba-3c122ad7c7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:36.242572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242154a2-8170-4fc3-bcba-3c122ad7c7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:36.242840 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242154a2-8170-4fc3-bcba-3c122ad7c7b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:36.253561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242154a2-8170-4fc3-bcba-3c122ad7c7b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-242154a2-8170-4fc3-bcba-3c122ad7c7b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:36.258384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:36.274369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:36.275357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:36.276089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 157/326] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Aug 17 16:05:35 2022] POST /identity/v3/groups => generated 226 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:05:36.276089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd370f0-9ffe-4706-8cd8-edf99d836eac None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:36.276442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 170/327] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:36.276442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242154a2-8170-4fc3-bcba-3c122ad7c7b9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:36.352315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:36.380435 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242154a2-8170-4fc3-bcba-3c122ad7c7b9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:36.409326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd370f0-9ffe-4706-8cd8-edf99d836eac None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:36.428161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c88eb-73a6-4d7e-a31e-0055bbff73fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:36.428867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c88eb-73a6-4d7e-a31e-0055bbff73fb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:36.429143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c88eb-73a6-4d7e-a31e-0055bbff73fb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:36.429470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c88eb-73a6-4d7e-a31e-0055bbff73fb None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:36.430142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c88eb-73a6-4d7e-a31e-0055bbff73fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:36.430443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c88eb-73a6-4d7e-a31e-0055bbff73fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:36.431824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c88eb-73a6-4d7e-a31e-0055bbff73fb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:36.441076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 171/328] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:36.445947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c88eb-73a6-4d7e-a31e-0055bbff73fb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:36.451684 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7b60e-f689-407d-9a3c-fcda7e8ca2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:36.452545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7b60e-f689-407d-9a3c-fcda7e8ca2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:36.452982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7b60e-f689-407d-9a3c-fcda7e8ca2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:36.453257 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7b60e-f689-407d-9a3c-fcda7e8ca2e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:36.465659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7b60e-f689-407d-9a3c-fcda7e8ca2e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-6bc7b60e-f689-407d-9a3c-fcda7e8ca2e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:36.471446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:36.472339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:36.473126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 158/329] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:36.478364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7b60e-f689-407d-9a3c-fcda7e8ca2e0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:36.521883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:36.579567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c88eb-73a6-4d7e-a31e-0055bbff73fb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:36.606347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7b60e-f689-407d-9a3c-fcda7e8ca2e0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:36.619867 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:36.624216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d1a3b-c4f4-4f06-8a4b-bc1d337ed346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:36.624853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d1a3b-c4f4-4f06-8a4b-bc1d337ed346 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:36.625124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d1a3b-c4f4-4f06-8a4b-bc1d337ed346 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:36.625454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d1a3b-c4f4-4f06-8a4b-bc1d337ed346 None admin] PATH_INFO: `/v3/users/d581f04cfa034cc398aa0cc13239ecbd` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:36.626753 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d1a3b-c4f4-4f06-8a4b-bc1d337ed346 None admin] RBAC: Authorizing `identity:get_user(user_id=d581f04cfa034cc398aa0cc13239ecbd)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:36.628291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d1a3b-c4f4-4f06-8a4b-bc1d337ed346 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:36.630126 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 172/330] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:36 2022] GET /identity/v3/users/d581f04cfa034cc398aa0cc13239ecbd => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:36.637034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d1a3b-c4f4-4f06-8a4b-bc1d337ed346 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:36.649080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab83f3-6f2a-4de3-9c9e-d4bd389f95a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:36.650131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab83f3-6f2a-4de3-9c9e-d4bd389f95a6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:36.650412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab83f3-6f2a-4de3-9c9e-d4bd389f95a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:36.652386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab83f3-6f2a-4de3-9c9e-d4bd389f95a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:36.652386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab83f3-6f2a-4de3-9c9e-d4bd389f95a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:36.652386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab83f3-6f2a-4de3-9c9e-d4bd389f95a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:36.653401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab83f3-6f2a-4de3-9c9e-d4bd389f95a6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:36.668912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 159/331] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:36.670114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab83f3-6f2a-4de3-9c9e-d4bd389f95a6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:36.771377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d1a3b-c4f4-4f06-8a4b-bc1d337ed346 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:36.791956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:36.803534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab83f3-6f2a-4de3-9c9e-d4bd389f95a6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:36.812372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9967b5c-fc15-4f11-a7b8-92c176c97e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:36.813274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9967b5c-fc15-4f11-a7b8-92c176c97e8a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:36.813751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9967b5c-fc15-4f11-a7b8-92c176c97e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:36.814196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9967b5c-fc15-4f11-a7b8-92c176c97e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:36.815107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9967b5c-fc15-4f11-a7b8-92c176c97e8a None admin] RBAC: Adding query filter params (role.id=a64cd92139fb4f1fb64f05f5a88f999f, user.id=d581f04cfa034cc398aa0cc13239ecbd, scope.system=all) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:36.815608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9967b5c-fc15-4f11-a7b8-92c176c97e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:36.817237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9967b5c-fc15-4f11-a7b8-92c176c97e8a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:36.834729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 173/332] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 17 16:05:36 2022] GET /identity/v3/role_assignments?user.id=d581f04cfa034cc398aa0cc13239ecbd&scope.system=all&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:36.849808 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3c2a5-d309-4c11-997a-851152371cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:36.850475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c2a5-d309-4c11-997a-851152371cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:36.850748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c2a5-d309-4c11-997a-851152371cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:36.851011 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3c2a5-d309-4c11-997a-851152371cf1 None admin] PATH_INFO: `/v3/users/85f93b553cc4437e92c00db4d9aed3d6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:36.854267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3c2a5-d309-4c11-997a-851152371cf1 None admin] RBAC: Authorizing `identity:get_user(user_id=85f93b553cc4437e92c00db4d9aed3d6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:36.856209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3c2a5-d309-4c11-997a-851152371cf1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:36.858586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 160/333] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:36 2022] GET /identity/v3/users/85f93b553cc4437e92c00db4d9aed3d6 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:36.864214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9967b5c-fc15-4f11-a7b8-92c176c97e8a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:36.992785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9967b5c-fc15-4f11-a7b8-92c176c97e8a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:37.032032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a3911-8fc4-4bbb-ab10-0c70f55c79cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:37.033116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a3911-8fc4-4bbb-ab10-0c70f55c79cb None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:37.033639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a3911-8fc4-4bbb-ab10-0c70f55c79cb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:37.034110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a3911-8fc4-4bbb-ab10-0c70f55c79cb None admin] PATH_INFO: `/v3/system/users/85f93b553cc4437e92c00db4d9aed3d6/roles/fca599016d83441ab8908df85d7fcbbd` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:37.035765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a3911-8fc4-4bbb-ab10-0c70f55c79cb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=85f93b553cc4437e92c00db4d9aed3d6, role_id=fca599016d83441ab8908df85d7fcbbd)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:37.037348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a3911-8fc4-4bbb-ab10-0c70f55c79cb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:37.106123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 174/334] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Aug 17 16:05:36 2022] PUT /identity/v3/system/users/85f93b553cc4437e92c00db4d9aed3d6/roles/fca599016d83441ab8908df85d7fcbbd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:05:38.377185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a100-4c7d-448d-9786-6ef5776b9a27 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:38.378225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a100-4c7d-448d-9786-6ef5776b9a27 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:38.378500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a100-4c7d-448d-9786-6ef5776b9a27 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:38.380073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 161/335] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:38.385610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb35c-8bc1-4cb1-bf32-4df2489c1a4c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:38.386024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb35c-8bc1-4cb1-bf32-4df2489c1a4c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:38.386291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb35c-8bc1-4cb1-bf32-4df2489c1a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:38.408887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9c0bb35c-8bc1-4cb1-bf32-4df2489c1a4c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:38.410120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9c0bb35c-8bc1-4cb1-bf32-4df2489c1a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:38.462835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:38.507358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 175/336] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:38.792508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf959132-4799-4714-be87-fadf592eb443 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:38.792878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf959132-4799-4714-be87-fadf592eb443 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:38.793080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf959132-4799-4714-be87-fadf592eb443 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:38.794651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 162/337] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:38.799977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba7e48-db51-48d1-960b-315083989ead None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:38.800265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba7e48-db51-48d1-960b-315083989ead None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:38.800540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba7e48-db51-48d1-960b-315083989ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:38.823431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a5ba7e48-db51-48d1-960b-315083989ead None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:38.825315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a5ba7e48-db51-48d1-960b-315083989ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:38.899320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 176/338] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:38.934414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf959132-4799-4714-be87-fadf592eb443 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:38.982161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:39.048398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf959132-4799-4714-be87-fadf592eb443 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:39.085238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba6ba3-24ab-4d14-b0b8-11f70e12e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:39.085899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba6ba3-24ab-4d14-b0b8-11f70e12e10c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.086169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba6ba3-24ab-4d14-b0b8-11f70e12e10c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.086436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba6ba3-24ab-4d14-b0b8-11f70e12e10c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.097110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba6ba3-24ab-4d14-b0b8-11f70e12e10c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-50ba6ba3-24ab-4d14-b0b8-11f70e12e10c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:39.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:39.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:39.103455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 163/339] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:39.109174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba7e48-db51-48d1-960b-315083989ead None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:39.218191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:39.224123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba7e48-db51-48d1-960b-315083989ead None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:39.259554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9ac09-62b0-4976-a95d-c0cda7910695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:39.260162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ac09-62b0-4976-a95d-c0cda7910695 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.260436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ac09-62b0-4976-a95d-c0cda7910695 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.260703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ac09-62b0-4976-a95d-c0cda7910695 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.262223 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9ac09-62b0-4976-a95d-c0cda7910695 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:39.262660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9ac09-62b0-4976-a95d-c0cda7910695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:39.264052 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9ac09-62b0-4976-a95d-c0cda7910695 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:39.273842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 177/340] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:39.279716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba6ba3-24ab-4d14-b0b8-11f70e12e10c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:39.374209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368c5c-83dd-42db-982c-5542ce145b06 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.374503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368c5c-83dd-42db-982c-5542ce145b06 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.374754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368c5c-83dd-42db-982c-5542ce145b06 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.376299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 178/341] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:05:39.382054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be3b8e-ce34-49bf-886c-5154c62ad02f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.382339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be3b8e-ce34-49bf-886c-5154c62ad02f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.382614 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be3b8e-ce34-49bf-886c-5154c62ad02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.393073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:39.397768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba6ba3-24ab-4d14-b0b8-11f70e12e10c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:39.416856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-70be3b8e-ce34-49bf-886c-5154c62ad02f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:39.418770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-70be3b8e-ce34-49bf-886c-5154c62ad02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:39.467543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4fa33-5e61-416d-b902-3fabc8f52787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:39.469203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4fa33-5e61-416d-b902-3fabc8f52787 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.469504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4fa33-5e61-416d-b902-3fabc8f52787 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.469771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4fa33-5e61-416d-b902-3fabc8f52787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.551464 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 179/342] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:39.552309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be3b8e-ce34-49bf-886c-5154c62ad02f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:39.598480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4fa33-5e61-416d-b902-3fabc8f52787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:39.599949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4fa33-5e61-416d-b902-3fabc8f52787 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:39.708194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:39.712206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 164/343] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:39.719633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4fa33-5e61-416d-b902-3fabc8f52787 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:39.731645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:39.746130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be3b8e-ce34-49bf-886c-5154c62ad02f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:39.794708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed24b55-88f2-46bc-8e0e-55164b8def17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:39.795371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed24b55-88f2-46bc-8e0e-55164b8def17 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.795655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed24b55-88f2-46bc-8e0e-55164b8def17 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.795933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed24b55-88f2-46bc-8e0e-55164b8def17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.807172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed24b55-88f2-46bc-8e0e-55164b8def17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-bed24b55-88f2-46bc-8e0e-55164b8def17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:39.812827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:39.813735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:39.814526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:39.818408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 180/344] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:39.823994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed24b55-88f2-46bc-8e0e-55164b8def17 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:39.832655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4fa33-5e61-416d-b902-3fabc8f52787 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:39.870921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3766fe7-809b-4255-924f-7d9fe6d837ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:39.871731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766fe7-809b-4255-924f-7d9fe6d837ef None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.872009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766fe7-809b-4255-924f-7d9fe6d837ef None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.872281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766fe7-809b-4255-924f-7d9fe6d837ef None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.873553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3766fe7-809b-4255-924f-7d9fe6d837ef None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:39.875193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3766fe7-809b-4255-924f-7d9fe6d837ef None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:39.877053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 165/345] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:39 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:39.883893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3766fe7-809b-4255-924f-7d9fe6d837ef None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:39.969840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:39.974759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed24b55-88f2-46bc-8e0e-55164b8def17 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:39.997224 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3766fe7-809b-4255-924f-7d9fe6d837ef None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:40.036458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e284a41-41b5-4d0f-b431-fbbd079cbade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:40.037080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284a41-41b5-4d0f-b431-fbbd079cbade None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.037372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284a41-41b5-4d0f-b431-fbbd079cbade None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.037661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284a41-41b5-4d0f-b431-fbbd079cbade None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.038206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7e9f8-d882-4578-b45c-2230da68beb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:40.038324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e284a41-41b5-4d0f-b431-fbbd079cbade None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:40.038638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e284a41-41b5-4d0f-b431-fbbd079cbade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:40.038889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7e9f8-d882-4578-b45c-2230da68beb4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.039164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7e9f8-d882-4578-b45c-2230da68beb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.039488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7e9f8-d882-4578-b45c-2230da68beb4 None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.040032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e284a41-41b5-4d0f-b431-fbbd079cbade None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:40.048744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7e9f8-d882-4578-b45c-2230da68beb4 None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:40.050224 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7e9f8-d882-4578-b45c-2230da68beb4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:40.052267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 166/346] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:39 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:40.054224 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 181/347] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:40.058288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7e9f8-d882-4578-b45c-2230da68beb4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:40.059612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e284a41-41b5-4d0f-b431-fbbd079cbade None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:40.082693 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:40.169313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7e9f8-d882-4578-b45c-2230da68beb4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:40.204196 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:40.212086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38538fff-cc96-4f99-a71f-197f52aacfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:40.212665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38538fff-cc96-4f99-a71f-197f52aacfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.212938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38538fff-cc96-4f99-a71f-197f52aacfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.213197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38538fff-cc96-4f99-a71f-197f52aacfa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.213956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38538fff-cc96-4f99-a71f-197f52aacfa1 None admin] RBAC: Adding query filter params (group.id=0a904516031649ffb237da697e70cadb, role.id=a64cd92139fb4f1fb64f05f5a88f999f, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:40.215099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38538fff-cc96-4f99-a71f-197f52aacfa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:40.216607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38538fff-cc96-4f99-a71f-197f52aacfa1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:40.222695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e284a41-41b5-4d0f-b431-fbbd079cbade None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:40.223172 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 167/348] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 17 16:05:40 2022] GET /identity/v3/role_assignments?group.id=0a904516031649ffb237da697e70cadb&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:40.223986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38538fff-cc96-4f99-a71f-197f52aacfa1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:40.282646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5c6c8-c4a5-49b2-aa77-7dc1d871dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:40.283285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5c6c8-c4a5-49b2-aa77-7dc1d871dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.283566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5c6c8-c4a5-49b2-aa77-7dc1d871dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.283841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5c6c8-c4a5-49b2-aa77-7dc1d871dbe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.367181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38538fff-cc96-4f99-a71f-197f52aacfa1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:40.397998 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5c6c8-c4a5-49b2-aa77-7dc1d871dbe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:40.399495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5c6c8-c4a5-49b2-aa77-7dc1d871dbe5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:40.414218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc2c61-2bb2-4d80-802f-d728289eda94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:40.414960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc2c61-2bb2-4d80-802f-d728289eda94 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.415237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc2c61-2bb2-4d80-802f-d728289eda94 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.415502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc2c61-2bb2-4d80-802f-d728289eda94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.420565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:40.430633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc2c61-2bb2-4d80-802f-d728289eda94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-75cc2c61-2bb2-4d80-802f-d728289eda94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:40.437006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:40.441143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:40.442002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 168/349] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:40.443925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc2c61-2bb2-4d80-802f-d728289eda94 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:40.513863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:40.563961 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc2c61-2bb2-4d80-802f-d728289eda94 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:40.600609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f41a7c-8a92-480f-80e1-b252765b6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:40.601224 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f41a7c-8a92-480f-80e1-b252765b6085 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.601529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f41a7c-8a92-480f-80e1-b252765b6085 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.601801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f41a7c-8a92-480f-80e1-b252765b6085 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.602469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f41a7c-8a92-480f-80e1-b252765b6085 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:40.602770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f41a7c-8a92-480f-80e1-b252765b6085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:40.604257 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f41a7c-8a92-480f-80e1-b252765b6085 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:40.613954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 169/350] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:40.615293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3a22-713b-4910-9b22-52f052095f55 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.615579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3a22-713b-4910-9b22-52f052095f55 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.615852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3a22-713b-4910-9b22-52f052095f55 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.617066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 170/351] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:40.621044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a3a22-713b-4910-9b22-52f052095f55 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:40.638088 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 182/352] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:05:40.639462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706270-81e4-424e-a2d2-37703c887590 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.639746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706270-81e4-424e-a2d2-37703c887590 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.640015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706270-81e4-424e-a2d2-37703c887590 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.641273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 183/353] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:40.646254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d5eb-08da-45b3-a8d0-197bf7c80a40 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.646531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d5eb-08da-45b3-a8d0-197bf7c80a40 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.646803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d5eb-08da-45b3-a8d0-197bf7c80a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.669332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5ed8d5eb-08da-45b3-a8d0-197bf7c80a40 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:40.670625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5ed8d5eb-08da-45b3-a8d0-197bf7c80a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:40.764723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a3a22-713b-4910-9b22-52f052095f55 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:40.768199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 184/354] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:40.769138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8d5eb-08da-45b3-a8d0-197bf7c80a40 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:40.796301 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:40.830577 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe3621-d51e-45eb-ba6b-0cdeb868fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:40.831193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe3621-d51e-45eb-ba6b-0cdeb868fe07 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.831470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe3621-d51e-45eb-ba6b-0cdeb868fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.831736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe3621-d51e-45eb-ba6b-0cdeb868fe07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.872522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:40.959767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe3621-d51e-45eb-ba6b-0cdeb868fe07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:40.961220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe3621-d51e-45eb-ba6b-0cdeb868fe07 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:40.963945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8d5eb-08da-45b3-a8d0-197bf7c80a40 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:41.006069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2a909-12af-4490-bc37-71d2e61b510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:41.007077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2a909-12af-4490-bc37-71d2e61b510e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:41.007590 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2a909-12af-4490-bc37-71d2e61b510e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:41.008059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2a909-12af-4490-bc37-71d2e61b510e None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:41.010623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2a909-12af-4490-bc37-71d2e61b510e None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:41.012951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2a909-12af-4490-bc37-71d2e61b510e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:41.015189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 185/355] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:40 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:41.018441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a1ff-e4d1-477f-ae24-075d0b91d5f3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:41.018975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a1ff-e4d1-477f-ae24-075d0b91d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:41.019463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a1ff-e4d1-477f-ae24-075d0b91d5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:41.044687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-53b4a1ff-e4d1-477f-ae24-075d0b91d5f3 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:41.047587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-53b4a1ff-e4d1-477f-ae24-075d0b91d5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:41.113125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 171/356] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:41.114024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe3621-d51e-45eb-ba6b-0cdeb868fe07 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:41.148985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:41.163090 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 186/357] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:41.163927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a1ff-e4d1-477f-ae24-075d0b91d5f3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:41.237625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:41.248143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe3621-d51e-45eb-ba6b-0cdeb868fe07 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:41.315514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc3003-afc6-4fd7-9e89-d9fdfb94959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:41.316072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc3003-afc6-4fd7-9e89-d9fdfb94959d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:41.316346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc3003-afc6-4fd7-9e89-d9fdfb94959d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:41.316614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc3003-afc6-4fd7-9e89-d9fdfb94959d None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:41.317757 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc3003-afc6-4fd7-9e89-d9fdfb94959d None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:41.319194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc3003-afc6-4fd7-9e89-d9fdfb94959d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:41.320753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 172/358] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:41 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:41.321798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc3003-afc6-4fd7-9e89-d9fdfb94959d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:41.334851 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a1ff-e4d1-477f-ae24-075d0b91d5f3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:41.376263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee76da-50ed-4ee2-b301-9bfa20e46e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:41.376900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee76da-50ed-4ee2-b301-9bfa20e46e54 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:41.377173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee76da-50ed-4ee2-b301-9bfa20e46e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:41.377563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee76da-50ed-4ee2-b301-9bfa20e46e54 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:41.378678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee76da-50ed-4ee2-b301-9bfa20e46e54 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:41.380218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee76da-50ed-4ee2-b301-9bfa20e46e54 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:41.382257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 187/359] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:41 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:41.383479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c9caa-52af-4f8c-b008-9aa40542525b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:41.383755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c9caa-52af-4f8c-b008-9aa40542525b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:41.384020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c9caa-52af-4f8c-b008-9aa40542525b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:41.385210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 188/360] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:41.385945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c9caa-52af-4f8c-b008-9aa40542525b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:41.427157 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:41.443162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc3003-afc6-4fd7-9e89-d9fdfb94959d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:41.480980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a9425-63aa-4605-9d22-0184e2519e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:41.481707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a9425-63aa-4605-9d22-0184e2519e17 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:41.481980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a9425-63aa-4605-9d22-0184e2519e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:41.482243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a9425-63aa-4605-9d22-0184e2519e17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:41.493403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a9425-63aa-4605-9d22-0184e2519e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a07a9425-63aa-4605-9d22-0184e2519e17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:41.498965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:41.501062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 173/361] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:41.503053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a9425-63aa-4605-9d22-0184e2519e17 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:41.507505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c9caa-52af-4f8c-b008-9aa40542525b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:41.522383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:41.550277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c5815-51e6-4e35-a329-94c0638e4327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:41.550888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c5815-51e6-4e35-a329-94c0638e4327 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:41.551165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c5815-51e6-4e35-a329-94c0638e4327 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:41.551435 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c5815-51e6-4e35-a329-94c0638e4327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:41.552167 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c5815-51e6-4e35-a329-94c0638e4327 None admin] RBAC: Adding query filter params (group.id=0a904516031649ffb237da697e70cadb, role.id=68da777efbc34e15a79e851577a8ee89, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:41.552471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c5815-51e6-4e35-a329-94c0638e4327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:41.554810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c5815-51e6-4e35-a329-94c0638e4327 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:41.563553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 189/362] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 17 16:05:41 2022] GET /identity/v3/role_assignments?group.id=0a904516031649ffb237da697e70cadb&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=68da777efbc34e15a79e851577a8ee89 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:41.565958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a8c49-ef53-4f76-a5c4-aaa141c718ba None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:41.566707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a8c49-ef53-4f76-a5c4-aaa141c718ba None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:41.567233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a8c49-ef53-4f76-a5c4-aaa141c718ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:41.596510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cb2a8c49-ef53-4f76-a5c4-aaa141c718ba None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:41.598119 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cb2a8c49-ef53-4f76-a5c4-aaa141c718ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:41.631539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a9425-63aa-4605-9d22-0184e2519e17 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:41.686342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08025-0b45-415b-bad3-368bc355e270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:41.687002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08025-0b45-415b-bad3-368bc355e270 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:41.687281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08025-0b45-415b-bad3-368bc355e270 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:41.687555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08025-0b45-415b-bad3-368bc355e270 None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:41.688841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee08025-0b45-415b-bad3-368bc355e270 None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:41.691138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee08025-0b45-415b-bad3-368bc355e270 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:41.693447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 174/363] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:41 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:41.694162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 190/364] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:41.695187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a8c49-ef53-4f76-a5c4-aaa141c718ba None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:41.698394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08025-0b45-415b-bad3-368bc355e270 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:41.732433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:41.843358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08025-0b45-415b-bad3-368bc355e270 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:41.845740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a8c49-ef53-4f76-a5c4-aaa141c718ba None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:41.849078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:41.890933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406061b2-e5e8-446b-b4f9-14bc19714ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:41.892018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406061b2-e5e8-446b-b4f9-14bc19714ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:41.892366 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406061b2-e5e8-446b-b4f9-14bc19714ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:41.892626 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eefdaa-4015-4bde-bfa8-122a7952cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:41.892976 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406061b2-e5e8-446b-b4f9-14bc19714ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:41.893735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406061b2-e5e8-446b-b4f9-14bc19714ca1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:41.894016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eefdaa-4015-4bde-bfa8-122a7952cc4b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:41.894118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406061b2-e5e8-446b-b4f9-14bc19714ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:41.894639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eefdaa-4015-4bde-bfa8-122a7952cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:41.895103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eefdaa-4015-4bde-bfa8-122a7952cc4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:41.895426 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406061b2-e5e8-446b-b4f9-14bc19714ca1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:41.906572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 191/365] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:41.907861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406061b2-e5e8-446b-b4f9-14bc19714ca1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:41.914126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eefdaa-4015-4bde-bfa8-122a7952cc4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-80eefdaa-4015-4bde-bfa8-122a7952cc4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:41.919767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:41.920650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:41.921473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:41.924188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 175/366] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:41.925203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eefdaa-4015-4bde-bfa8-122a7952cc4b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:42.043150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406061b2-e5e8-446b-b4f9-14bc19714ca1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:42.049583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:42.087557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7564e37-6404-4a83-bda5-5390716da085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:42.088522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564e37-6404-4a83-bda5-5390716da085 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:42.089048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564e37-6404-4a83-bda5-5390716da085 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:42.089168 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eefdaa-4015-4bde-bfa8-122a7952cc4b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:42.089723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564e37-6404-4a83-bda5-5390716da085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:42.090828 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7564e37-6404-4a83-bda5-5390716da085 None admin] RBAC: Adding query filter params (group.id=0a904516031649ffb237da697e70cadb, role.id=a64cd92139fb4f1fb64f05f5a88f999f, scope.project.id=cd7db93d6ee541a491174595f83a43ef) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:42.091333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7564e37-6404-4a83-bda5-5390716da085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:42.094172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7564e37-6404-4a83-bda5-5390716da085 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:42.100474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 192/367] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 17 16:05:41 2022] GET /identity/v3/role_assignments?group.id=0a904516031649ffb237da697e70cadb&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:42.101633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7564e37-6404-4a83-bda5-5390716da085 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:42.136786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:42.136975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c280ad9-2cc4-485f-b05c-a9ce3bff7d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:42.145423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c280ad9-2cc4-485f-b05c-a9ce3bff7d9a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:42.145423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c280ad9-2cc4-485f-b05c-a9ce3bff7d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:42.145423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c280ad9-2cc4-485f-b05c-a9ce3bff7d9a None admin] PATH_INFO: `/v3/users/85f93b553cc4437e92c00db4d9aed3d6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:42.145423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c280ad9-2cc4-485f-b05c-a9ce3bff7d9a None admin] RBAC: Authorizing `identity:get_user(user_id=85f93b553cc4437e92c00db4d9aed3d6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:42.145423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c280ad9-2cc4-485f-b05c-a9ce3bff7d9a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:42.145423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 176/368] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:05:41 2022] GET /identity/v3/users/85f93b553cc4437e92c00db4d9aed3d6 => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:42.145912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c280ad9-2cc4-485f-b05c-a9ce3bff7d9a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:42.274182 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7564e37-6404-4a83-bda5-5390716da085 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:42.318597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c280ad9-2cc4-485f-b05c-a9ce3bff7d9a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:42.323063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46defa0a-1122-4305-b794-0c949752b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:42.324360 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46defa0a-1122-4305-b794-0c949752b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:42.324633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46defa0a-1122-4305-b794-0c949752b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:42.324907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46defa0a-1122-4305-b794-0c949752b6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:42.325641 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46defa0a-1122-4305-b794-0c949752b6c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:42.325939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46defa0a-1122-4305-b794-0c949752b6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:42.327326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46defa0a-1122-4305-b794-0c949752b6c0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:42.337260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 193/369] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:42.338139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46defa0a-1122-4305-b794-0c949752b6c0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:42.359414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fa5a1-a574-46dd-8066-7a5acd27e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:42.360067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa5a1-a574-46dd-8066-7a5acd27e774 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:42.360345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa5a1-a574-46dd-8066-7a5acd27e774 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:42.360615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa5a1-a574-46dd-8066-7a5acd27e774 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:42.372312 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fa5a1-a574-46dd-8066-7a5acd27e774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-438fa5a1-a574-46dd-8066-7a5acd27e774 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:42.377087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:42.378123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:42.378912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 177/370] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:42.379557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fa5a1-a574-46dd-8066-7a5acd27e774 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:42.388816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:42.497758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fa5a1-a574-46dd-8066-7a5acd27e774 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:42.520870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:42.535324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555075f-6746-4be3-b21c-a403b20ba20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:42.536250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555075f-6746-4be3-b21c-a403b20ba20c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:42.536695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555075f-6746-4be3-b21c-a403b20ba20c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:42.537132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555075f-6746-4be3-b21c-a403b20ba20c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:42.537235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46defa0a-1122-4305-b794-0c949752b6c0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:42.611111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555075f-6746-4be3-b21c-a403b20ba20c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:42.612965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555075f-6746-4be3-b21c-a403b20ba20c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:42.615312 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:42.615507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9e28a-1fd6-4209-9291-ad0dcff4b983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:42.616127 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9e28a-1fd6-4209-9291-ad0dcff4b983 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:42.616364 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9e28a-1fd6-4209-9291-ad0dcff4b983 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:42.616639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9e28a-1fd6-4209-9291-ad0dcff4b983 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:42.618181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9e28a-1fd6-4209-9291-ad0dcff4b983 None admin] RBAC: Adding query filter params (role.id=fca599016d83441ab8908df85d7fcbbd, user.id=85f93b553cc4437e92c00db4d9aed3d6, scope.system=all) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:42.618181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9e28a-1fd6-4209-9291-ad0dcff4b983 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:42.619242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9e28a-1fd6-4209-9291-ad0dcff4b983 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:42.644844 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 194/371] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 17 16:05:42 2022] GET /identity/v3/role_assignments?user.id=85f93b553cc4437e92c00db4d9aed3d6&scope.system=all&role.id=fca599016d83441ab8908df85d7fcbbd => generated 510 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:42.645621 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9e28a-1fd6-4209-9291-ad0dcff4b983 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:42.744293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 178/372] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:42.748337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555075f-6746-4be3-b21c-a403b20ba20c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:42.878158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9e28a-1fd6-4209-9291-ad0dcff4b983 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:42.906344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555075f-6746-4be3-b21c-a403b20ba20c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:42.909080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:42.934837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c94c3-5763-415f-8718-dca53ca4b186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:42.935450 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c94c3-5763-415f-8718-dca53ca4b186 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:42.935727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c94c3-5763-415f-8718-dca53ca4b186 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:42.936142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c94c3-5763-415f-8718-dca53ca4b186 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:42.936833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c94c3-5763-415f-8718-dca53ca4b186 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:42.937130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c94c3-5763-415f-8718-dca53ca4b186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:42.938572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c94c3-5763-415f-8718-dca53ca4b186 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:42.951680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 195/373] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:42.958862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c94c3-5763-415f-8718-dca53ca4b186 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:42.980022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:43.006977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5029e24-dd58-4258-ba3a-061f5c9c6e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:43.007624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5029e24-dd58-4258-ba3a-061f5c9c6e9f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.007898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5029e24-dd58-4258-ba3a-061f5c9c6e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.008166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5029e24-dd58-4258-ba3a-061f5c9c6e9f None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.010106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5029e24-dd58-4258-ba3a-061f5c9c6e9f None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:43.012266 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5029e24-dd58-4258-ba3a-061f5c9c6e9f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:43.014254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 179/374] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:42 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:43.023013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5029e24-dd58-4258-ba3a-061f5c9c6e9f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:43.097844 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c94c3-5763-415f-8718-dca53ca4b186 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:43.146665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0c5e7-8168-4f10-aba5-e19812050321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:43.147630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0c5e7-8168-4f10-aba5-e19812050321 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.147930 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5029e24-dd58-4258-ba3a-061f5c9c6e9f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:43.148307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0c5e7-8168-4f10-aba5-e19812050321 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.148783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0c5e7-8168-4f10-aba5-e19812050321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.207002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9c6a7-8513-4b33-b56f-37ff8fe529a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:43.207643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9c6a7-8513-4b33-b56f-37ff8fe529a6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.208019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9c6a7-8513-4b33-b56f-37ff8fe529a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.208347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9c6a7-8513-4b33-b56f-37ff8fe529a6 None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.209458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9c6a7-8513-4b33-b56f-37ff8fe529a6 None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:43.211138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9c6a7-8513-4b33-b56f-37ff8fe529a6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:43.213105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 180/375] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:43 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:43.214386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035ec15-5d12-4ed6-b1a6-3d320641f4b5 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.214667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035ec15-5d12-4ed6-b1a6-3d320641f4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.215028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035ec15-5d12-4ed6-b1a6-3d320641f4b5 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.216525 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 181/376] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:43.219949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035ec15-5d12-4ed6-b1a6-3d320641f4b5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:43.241420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0c5e7-8168-4f10-aba5-e19812050321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:43.242891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0c5e7-8168-4f10-aba5-e19812050321 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:43.257707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:43.269169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:43.337832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035ec15-5d12-4ed6-b1a6-3d320641f4b5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:43.354800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 196/377] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:43.356632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025b9fb-38c7-4179-9c31-141b5abc5f86 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.356916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025b9fb-38c7-4179-9c31-141b5abc5f86 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.357185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025b9fb-38c7-4179-9c31-141b5abc5f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.376061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1025b9fb-38c7-4179-9c31-141b5abc5f86 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:43.376568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fcb77-c1b2-41cb-8fd7-e4f235903579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:43.377179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fcb77-c1b2-41cb-8fd7-e4f235903579 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.377278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1025b9fb-38c7-4179-9c31-141b5abc5f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:43.377483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fcb77-c1b2-41cb-8fd7-e4f235903579 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.377749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fcb77-c1b2-41cb-8fd7-e4f235903579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.378467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fcb77-c1b2-41cb-8fd7-e4f235903579 None admin] RBAC: Adding query filter params (group.id=0a904516031649ffb237da697e70cadb, role.id=68da777efbc34e15a79e851577a8ee89, scope.project.id=cd7db93d6ee541a491174595f83a43ef) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:43.378769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fcb77-c1b2-41cb-8fd7-e4f235903579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:43.380428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fcb77-c1b2-41cb-8fd7-e4f235903579 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:43.387100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 182/378] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 17 16:05:43 2022] GET /identity/v3/role_assignments?group.id=0a904516031649ffb237da697e70cadb&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=68da777efbc34e15a79e851577a8ee89 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:43.388057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fcb77-c1b2-41cb-8fd7-e4f235903579 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:43.455221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 197/379] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:43.510139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fcb77-c1b2-41cb-8fd7-e4f235903579 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:43.512394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:43.557479 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a306d-e185-4c94-b9f2-e3f2cff710d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:43.558690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a306d-e185-4c94-b9f2-e3f2cff710d6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.558966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a306d-e185-4c94-b9f2-e3f2cff710d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.559233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a306d-e185-4c94-b9f2-e3f2cff710d6 None admin] PATH_INFO: `/v3/projects/2a24cdfa264d45f188d3bf7cc23a9da7` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.560490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a306d-e185-4c94-b9f2-e3f2cff710d6 None admin] RBAC: Authorizing `identity:get_project(project_id=2a24cdfa264d45f188d3bf7cc23a9da7)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:43.562061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a306d-e185-4c94-b9f2-e3f2cff710d6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:43.564030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 183/380] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:43 2022] GET /identity/v3/projects/2a24cdfa264d45f188d3bf7cc23a9da7 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:43.569427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025b9fb-38c7-4179-9c31-141b5abc5f86 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:43.617495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:43.678695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025b9fb-38c7-4179-9c31-141b5abc5f86 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:43.718789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa82cc-40da-4925-9fbe-0e7ae48d76e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:43.719772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa82cc-40da-4925-9fbe-0e7ae48d76e2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.720242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa82cc-40da-4925-9fbe-0e7ae48d76e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.720704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa82cc-40da-4925-9fbe-0e7ae48d76e2 None admin] PATH_INFO: `/v3/groups/021081f6f3044b68ab16bc7a2fa54a42` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.728933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa82cc-40da-4925-9fbe-0e7ae48d76e2 None admin] RBAC: Authorizing `identity:get_group(group_id=021081f6f3044b68ab16bc7a2fa54a42)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:43.731423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa82cc-40da-4925-9fbe-0e7ae48d76e2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:43.733895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 198/381] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:43 2022] GET /identity/v3/groups/021081f6f3044b68ab16bc7a2fa54a42 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:43.740564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a306d-e185-4c94-b9f2-e3f2cff710d6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:43.811246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa82cc-40da-4925-9fbe-0e7ae48d76e2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:43.917496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a306d-e185-4c94-b9f2-e3f2cff710d6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:43.972823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535d991-5845-4c95-bb8f-537399a46fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:43.973344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535d991-5845-4c95-bb8f-537399a46fde None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.973788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535d991-5845-4c95-bb8f-537399a46fde None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.974061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535d991-5845-4c95-bb8f-537399a46fde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.977259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535d991-5845-4c95-bb8f-537399a46fde None admin] RBAC: Adding query filter params (group.id=021081f6f3044b68ab16bc7a2fa54a42, role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=2a24cdfa264d45f188d3bf7cc23a9da7) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:43.977644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535d991-5845-4c95-bb8f-537399a46fde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:43.979082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535d991-5845-4c95-bb8f-537399a46fde None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:43.986378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 184/382] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 17 16:05:43 2022] GET /identity/v3/role_assignments?group.id=021081f6f3044b68ab16bc7a2fa54a42&scope.project.id=2a24cdfa264d45f188d3bf7cc23a9da7&role.id=28beda93f70d4c549352145ddee01aac => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:44.041778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa82cc-40da-4925-9fbe-0e7ae48d76e2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:44.056686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:44.100457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59febac4-e4c1-404b-9823-5d341ad91e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:44.101098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59febac4-e4c1-404b-9823-5d341ad91e44 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.101389 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59febac4-e4c1-404b-9823-5d341ad91e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.101679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59febac4-e4c1-404b-9823-5d341ad91e44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.118023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59febac4-e4c1-404b-9823-5d341ad91e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-59febac4-e4c1-404b-9823-5d341ad91e44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:44.123392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:44.124489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:44.125451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 199/383] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:44.130527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535d991-5845-4c95-bb8f-537399a46fde None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:44.203666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:44.254208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe2671-84f8-4487-92b6-0430ca028d8e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.254505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe2671-84f8-4487-92b6-0430ca028d8e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.254691 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe2671-84f8-4487-92b6-0430ca028d8e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.258743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 200/384] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:44.265728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d88408-18df-4b8a-9007-5ba94f5c80df None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.266142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d88408-18df-4b8a-9007-5ba94f5c80df None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.266536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d88408-18df-4b8a-9007-5ba94f5c80df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.295544 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c7d88408-18df-4b8a-9007-5ba94f5c80df None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:44.296748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c7d88408-18df-4b8a-9007-5ba94f5c80df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:44.301482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535d991-5845-4c95-bb8f-537399a46fde None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:44.360175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8b0a3-5b60-4147-87e8-663e75b3e832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:44.360802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8b0a3-5b60-4147-87e8-663e75b3e832 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.361077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8b0a3-5b60-4147-87e8-663e75b3e832 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.361346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8b0a3-5b60-4147-87e8-663e75b3e832 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.362037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8b0a3-5b60-4147-87e8-663e75b3e832 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:44.362335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8b0a3-5b60-4147-87e8-663e75b3e832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:44.363711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8b0a3-5b60-4147-87e8-663e75b3e832 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:44.383694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 185/385] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:44.389689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8b0a3-5b60-4147-87e8-663e75b3e832 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:44.433613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 201/386] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:44.532910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:44.539149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8b0a3-5b60-4147-87e8-663e75b3e832 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:44.592012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75a42e-50ec-437f-bcdf-ed92278e06a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:44.592723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75a42e-50ec-437f-bcdf-ed92278e06a7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.593001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75a42e-50ec-437f-bcdf-ed92278e06a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.593271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75a42e-50ec-437f-bcdf-ed92278e06a7 None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.594495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75a42e-50ec-437f-bcdf-ed92278e06a7 None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:44.595932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75a42e-50ec-437f-bcdf-ed92278e06a7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:44.597701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 186/387] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:44 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:44.603296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d88408-18df-4b8a-9007-5ba94f5c80df None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:44.710795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:44.719379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d88408-18df-4b8a-9007-5ba94f5c80df None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:44.758127 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef626c1-6f69-4ace-acc9-da84f786fcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:44.758778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef626c1-6f69-4ace-acc9-da84f786fcf5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.759053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef626c1-6f69-4ace-acc9-da84f786fcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.759327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef626c1-6f69-4ace-acc9-da84f786fcf5 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.760459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef626c1-6f69-4ace-acc9-da84f786fcf5 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:44.762305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef626c1-6f69-4ace-acc9-da84f786fcf5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:44.768872 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 202/388] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:44 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:44.770241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75a42e-50ec-437f-bcdf-ed92278e06a7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:44.836734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953803-a3f0-4794-a1cd-4ad5c26c2b94 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.837044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953803-a3f0-4794-a1cd-4ad5c26c2b94 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.837199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953803-a3f0-4794-a1cd-4ad5c26c2b94 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.838610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 203/389] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:44.845871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab74dd-25b1-4948-91b9-cf2d941797f5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.846159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab74dd-25b1-4948-91b9-cf2d941797f5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.846433 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab74dd-25b1-4948-91b9-cf2d941797f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.867530 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e7ab74dd-25b1-4948-91b9-cf2d941797f5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:44.869197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e7ab74dd-25b1-4948-91b9-cf2d941797f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:44.935837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75a42e-50ec-437f-bcdf-ed92278e06a7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:44.959036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 204/390] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:44.960817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab74dd-25b1-4948-91b9-cf2d941797f5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:44.991681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de752cd-e240-4499-917a-5d68c57b701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:44.992850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de752cd-e240-4499-917a-5d68c57b701a None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.993197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de752cd-e240-4499-917a-5d68c57b701a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.993701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de752cd-e240-4499-917a-5d68c57b701a None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/groups/0a904516031649ffb237da697e70cadb/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.997227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de752cd-e240-4499-917a-5d68c57b701a None admin] RBAC: Authorizing `identity:create_grant(project_id=9f6f6d4571bf4ceeb09359528c51bbad, group_id=0a904516031649ffb237da697e70cadb, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:44.999349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de752cd-e240-4499-917a-5d68c57b701a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:45.077085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 187/391] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 17 16:05:44 2022] PUT /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/groups/0a904516031649ffb237da697e70cadb/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:45.081269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:45.089850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab74dd-25b1-4948-91b9-cf2d941797f5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:45.148107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8340b97-daf9-470b-b5a7-404b7b3c5e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:45.148761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8340b97-daf9-470b-b5a7-404b7b3c5e91 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:45.149035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8340b97-daf9-470b-b5a7-404b7b3c5e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:45.149302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8340b97-daf9-470b-b5a7-404b7b3c5e91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:45.169234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8340b97-daf9-470b-b5a7-404b7b3c5e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f8340b97-daf9-470b-b5a7-404b7b3c5e91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:45.174054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:45.175049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:45.175848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 205/392] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:45.183693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de752cd-e240-4499-917a-5d68c57b701a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:45.225291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:45.317789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de752cd-e240-4499-917a-5d68c57b701a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:45.358173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf9d3-0450-44e4-abf0-713788d09adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:45.358794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf9d3-0450-44e4-abf0-713788d09adc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:45.359070 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf9d3-0450-44e4-abf0-713788d09adc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:45.359335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf9d3-0450-44e4-abf0-713788d09adc None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:45.360005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf9d3-0450-44e4-abf0-713788d09adc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:45.360303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf9d3-0450-44e4-abf0-713788d09adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:45.361699 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf9d3-0450-44e4-abf0-713788d09adc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:45.375309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8340b97-daf9-470b-b5a7-404b7b3c5e91 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:45.390849 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 188/393] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:45.393896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf9d3-0450-44e4-abf0-713788d09adc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:45.553895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:45.560348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8340b97-daf9-470b-b5a7-404b7b3c5e91 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:45.599611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf9d3-0450-44e4-abf0-713788d09adc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:45.610667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4439-de59-44f7-bd36-3a3b6ffbf5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:45.611282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4439-de59-44f7-bd36-3a3b6ffbf5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:45.611492 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4439-de59-44f7-bd36-3a3b6ffbf5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:45.611756 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4439-de59-44f7-bd36-3a3b6ffbf5d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:45.632434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e4439-de59-44f7-bd36-3a3b6ffbf5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-dc4e4439-de59-44f7-bd36-3a3b6ffbf5d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:45.643100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:45.644059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:45.644826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:45.646009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 206/394] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:45.653787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4439-de59-44f7-bd36-3a3b6ffbf5d3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:45.675122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971dbc7-a667-44e7-926f-3e732c7d5b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:45.675122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971dbc7-a667-44e7-926f-3e732c7d5b4a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:45.675384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971dbc7-a667-44e7-926f-3e732c7d5b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:45.675628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971dbc7-a667-44e7-926f-3e732c7d5b4a None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:45.676568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971dbc7-a667-44e7-926f-3e732c7d5b4a None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:45.679866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:45.679985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971dbc7-a667-44e7-926f-3e732c7d5b4a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:45.679985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 189/395] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:45 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:45.689395 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971dbc7-a667-44e7-926f-3e732c7d5b4a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:45.844815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4439-de59-44f7-bd36-3a3b6ffbf5d3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:45.888394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971dbc7-a667-44e7-926f-3e732c7d5b4a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:45.919656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb27fb0-3af3-4fa0-aa70-9f0c8a4512b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:45.920280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb27fb0-3af3-4fa0-aa70-9f0c8a4512b1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:45.920551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb27fb0-3af3-4fa0-aa70-9f0c8a4512b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:45.920804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb27fb0-3af3-4fa0-aa70-9f0c8a4512b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:45.921496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb27fb0-3af3-4fa0-aa70-9f0c8a4512b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:45.921790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb27fb0-3af3-4fa0-aa70-9f0c8a4512b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:45.923169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb27fb0-3af3-4fa0-aa70-9f0c8a4512b1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:45.938406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 207/396] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:45.944370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb27fb0-3af3-4fa0-aa70-9f0c8a4512b1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:45.959258 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295a521-6dd3-49ba-b5c2-32b77bc53b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:45.960054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295a521-6dd3-49ba-b5c2-32b77bc53b1d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:45.960339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295a521-6dd3-49ba-b5c2-32b77bc53b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:45.960610 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295a521-6dd3-49ba-b5c2-32b77bc53b1d None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:45.963449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295a521-6dd3-49ba-b5c2-32b77bc53b1d None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:45.964987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295a521-6dd3-49ba-b5c2-32b77bc53b1d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:45.968480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 190/397] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:45 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:45.974348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295a521-6dd3-49ba-b5c2-32b77bc53b1d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:46.009353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:46.056430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:46.092093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb27fb0-3af3-4fa0-aa70-9f0c8a4512b1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:46.114667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295a521-6dd3-49ba-b5c2-32b77bc53b1d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:46.136262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c4c3-4321-4b29-a2d9-b409c82ebf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:46.137284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c4c3-4321-4b29-a2d9-b409c82ebf22 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:46.137593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c4c3-4321-4b29-a2d9-b409c82ebf22 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:46.137867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c4c3-4321-4b29-a2d9-b409c82ebf22 None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:46.139055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058c4c3-4321-4b29-a2d9-b409c82ebf22 None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:46.141057 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058c4c3-4321-4b29-a2d9-b409c82ebf22 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:46.142691 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 208/398] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:45 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:46.143997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69d07-e398-428b-967c-bf57436f381b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:46.144286 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69d07-e398-428b-967c-bf57436f381b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:46.144533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69d07-e398-428b-967c-bf57436f381b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:46.146004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 209/399] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:46.148547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69d07-e398-428b-967c-bf57436f381b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:46.162650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47e9bf-95dd-43a3-a489-492d6fb87179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:46.163422 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47e9bf-95dd-43a3-a489-492d6fb87179 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:46.163763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47e9bf-95dd-43a3-a489-492d6fb87179 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:46.164035 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47e9bf-95dd-43a3-a489-492d6fb87179 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/groups/0a904516031649ffb237da697e70cadb/roles/68da777efbc34e15a79e851577a8ee89` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:46.166391 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47e9bf-95dd-43a3-a489-492d6fb87179 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f6f6d4571bf4ceeb09359528c51bbad, group_id=0a904516031649ffb237da697e70cadb, role_id=68da777efbc34e15a79e851577a8ee89)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:46.168463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47e9bf-95dd-43a3-a489-492d6fb87179 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:46.266173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 191/400] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 17 16:05:45 2022] PUT /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad/groups/0a904516031649ffb237da697e70cadb/roles/68da777efbc34e15a79e851577a8ee89 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:46.267187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce99e1-c3cd-4e81-a330-69280ed7fbe6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:46.267472 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce99e1-c3cd-4e81-a330-69280ed7fbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:46.267742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce99e1-c3cd-4e81-a330-69280ed7fbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:46.282823 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69d07-e398-428b-967c-bf57436f381b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:46.306412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9cce99e1-c3cd-4e81-a330-69280ed7fbe6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:46.307741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9cce99e1-c3cd-4e81-a330-69280ed7fbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:46.335064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d2c3f-4a9b-4beb-88a5-fca6633a40fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:46.335726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d2c3f-4a9b-4beb-88a5-fca6633a40fb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:46.336002 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d2c3f-4a9b-4beb-88a5-fca6633a40fb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:46.336270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d2c3f-4a9b-4beb-88a5-fca6633a40fb None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:46.338469 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d2c3f-4a9b-4beb-88a5-fca6633a40fb None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:46.340663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d2c3f-4a9b-4beb-88a5-fca6633a40fb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:46.342487 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 210/401] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:46 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:46.355512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d2c3f-4a9b-4beb-88a5-fca6633a40fb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:46.388679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:46.422378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 192/402] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:46.549578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d2c3f-4a9b-4beb-88a5-fca6633a40fb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:46.591333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2058c-93dc-4e0e-bd63-a4fd72392f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:46.592012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2058c-93dc-4e0e-bd63-a4fd72392f59 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:46.592290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2058c-93dc-4e0e-bd63-a4fd72392f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:46.592562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2058c-93dc-4e0e-bd63-a4fd72392f59 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef/groups/0a904516031649ffb237da697e70cadb/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:46.595532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2058c-93dc-4e0e-bd63-a4fd72392f59 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd7db93d6ee541a491174595f83a43ef, group_id=0a904516031649ffb237da697e70cadb, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:46.596989 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2058c-93dc-4e0e-bd63-a4fd72392f59 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:46.635080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9140800-080a-4f7e-a0db-20858288d80c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:46.635597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9140800-080a-4f7e-a0db-20858288d80c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:46.635750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9140800-080a-4f7e-a0db-20858288d80c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:46.637430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 193/403] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:05:46.642934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983dba7-ff4c-46c1-8c10-24e641d88d42 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:46.643467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983dba7-ff4c-46c1-8c10-24e641d88d42 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:46.643746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983dba7-ff4c-46c1-8c10-24e641d88d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:46.670414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2983dba7-ff4c-46c1-8c10-24e641d88d42 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:46.671618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2983dba7-ff4c-46c1-8c10-24e641d88d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:46.679830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:46.708687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 211/404] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 17 16:05:46 2022] PUT /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef/groups/0a904516031649ffb237da697e70cadb/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:46.752102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 194/405] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:46.758975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2058c-93dc-4e0e-bd63-a4fd72392f59 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:46.841812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:46.876201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2058c-93dc-4e0e-bd63-a4fd72392f59 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:46.928454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4629a1-aa42-4d38-8150-d6431d8408b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:46.929095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4629a1-aa42-4d38-8150-d6431d8408b2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:46.929388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4629a1-aa42-4d38-8150-d6431d8408b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:46.929679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4629a1-aa42-4d38-8150-d6431d8408b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:46.942896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4629a1-aa42-4d38-8150-d6431d8408b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8f4629a1-aa42-4d38-8150-d6431d8408b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:46.949000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:46.950011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:46.951368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 212/406] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:46.956103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983dba7-ff4c-46c1-8c10-24e641d88d42 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:47.096010 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983dba7-ff4c-46c1-8c10-24e641d88d42 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:47.134661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d704a8-e84a-4b3b-b1ac-93462750ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:47.135507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d704a8-e84a-4b3b-b1ac-93462750ef51 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:47.136004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d704a8-e84a-4b3b-b1ac-93462750ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:47.136429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d704a8-e84a-4b3b-b1ac-93462750ef51 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:47.137287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d704a8-e84a-4b3b-b1ac-93462750ef51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:47.137762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d704a8-e84a-4b3b-b1ac-93462750ef51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:47.139369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d704a8-e84a-4b3b-b1ac-93462750ef51 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:47.148492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 195/407] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:47.154526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4629a1-aa42-4d38-8150-d6431d8408b2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:47.232278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d704a8-e84a-4b3b-b1ac-93462750ef51 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:47.253907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:47.283688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4629a1-aa42-4d38-8150-d6431d8408b2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:47.341686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:47.349258 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aec59-b5bf-4188-b480-c6da25e225da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:47.349923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aec59-b5bf-4188-b480-c6da25e225da None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:47.350199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aec59-b5bf-4188-b480-c6da25e225da None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:47.350470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aec59-b5bf-4188-b480-c6da25e225da None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:47.353805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604aec59-b5bf-4188-b480-c6da25e225da None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:47.355514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604aec59-b5bf-4188-b480-c6da25e225da None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:47.357109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 213/408] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:47 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:47.366294 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aec59-b5bf-4188-b480-c6da25e225da None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:47.429674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d704a8-e84a-4b3b-b1ac-93462750ef51 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:47.504851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a43123-60da-4e18-be0e-b6cf3fdefa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:47.505424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43123-60da-4e18-be0e-b6cf3fdefa21 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:47.505706 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43123-60da-4e18-be0e-b6cf3fdefa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:47.505972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43123-60da-4e18-be0e-b6cf3fdefa21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:47.524887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a43123-60da-4e18-be0e-b6cf3fdefa21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-81a43123-60da-4e18-be0e-b6cf3fdefa21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:47.532376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:47.533264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:47.534075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 196/409] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:47.539887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a43123-60da-4e18-be0e-b6cf3fdefa21 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:47.564779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aec59-b5bf-4188-b480-c6da25e225da None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:47.623501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8c702-bb53-4a6a-93ec-bf7f1241e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:47.624577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8c702-bb53-4a6a-93ec-bf7f1241e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:47.625050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8c702-bb53-4a6a-93ec-bf7f1241e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:47.625787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8c702-bb53-4a6a-93ec-bf7f1241e3a1 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:47.627961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8c702-bb53-4a6a-93ec-bf7f1241e3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:47.630309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8c702-bb53-4a6a-93ec-bf7f1241e3a1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:47.632189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 214/410] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:47 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:47.634062 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d15b32-e9af-4d87-ad3f-e8ed3a0e0732 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:47.634785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d15b32-e9af-4d87-ad3f-e8ed3a0e0732 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:47.635283 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d15b32-e9af-4d87-ad3f-e8ed3a0e0732 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:47.644615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 215/411] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:47.644615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d15b32-e9af-4d87-ad3f-e8ed3a0e0732 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:47.668004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:47.724951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a43123-60da-4e18-be0e-b6cf3fdefa21 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:47.727093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:47.763620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d15b32-e9af-4d87-ad3f-e8ed3a0e0732 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:47.772153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d16c6-aff4-4451-8710-ff5a8ae8b032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:47.772946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d16c6-aff4-4451-8710-ff5a8ae8b032 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:47.773391 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d16c6-aff4-4451-8710-ff5a8ae8b032 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:47.774252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d16c6-aff4-4451-8710-ff5a8ae8b032 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:47.775077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d16c6-aff4-4451-8710-ff5a8ae8b032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:47.775918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d16c6-aff4-4451-8710-ff5a8ae8b032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:47.778398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d16c6-aff4-4451-8710-ff5a8ae8b032 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:47.790630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 197/412] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:47.792712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70477634-e2f9-4f6e-a8ba-0318b8225c6f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:47.793168 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70477634-e2f9-4f6e-a8ba-0318b8225c6f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:47.793999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70477634-e2f9-4f6e-a8ba-0318b8225c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:47.801811 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24ddb7-e1c0-4861-a57e-4404c4f9e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:47.802672 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24ddb7-e1c0-4861-a57e-4404c4f9e3bb None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:47.803868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24ddb7-e1c0-4861-a57e-4404c4f9e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:47.803868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24ddb7-e1c0-4861-a57e-4404c4f9e3bb None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef/groups/0a904516031649ffb237da697e70cadb/roles/68da777efbc34e15a79e851577a8ee89` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:47.805938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24ddb7-e1c0-4861-a57e-4404c4f9e3bb None admin] RBAC: Authorizing `identity:create_grant(project_id=cd7db93d6ee541a491174595f83a43ef, group_id=0a904516031649ffb237da697e70cadb, role_id=68da777efbc34e15a79e851577a8ee89)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:47.807680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24ddb7-e1c0-4861-a57e-4404c4f9e3bb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:47.817061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-70477634-e2f9-4f6e-a8ba-0318b8225c6f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:47.818295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-70477634-e2f9-4f6e-a8ba-0318b8225c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:47.880819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 216/413] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 17 16:05:47 2022] PUT /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef/groups/0a904516031649ffb237da697e70cadb/roles/68da777efbc34e15a79e851577a8ee89 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:47.882028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24ddb7-e1c0-4861-a57e-4404c4f9e3bb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:47.926559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 198/414] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:48.025347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24ddb7-e1c0-4861-a57e-4404c4f9e3bb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:48.065758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:48.080299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428552c9-9787-475c-80b7-5c0b0e247586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:48.080957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428552c9-9787-475c-80b7-5c0b0e247586 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.081236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428552c9-9787-475c-80b7-5c0b0e247586 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.081546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428552c9-9787-475c-80b7-5c0b0e247586 None admin] PATH_INFO: `/v3/groups/021081f6f3044b68ab16bc7a2fa54a42` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.086165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428552c9-9787-475c-80b7-5c0b0e247586 None admin] RBAC: Authorizing `identity:get_group(group_id=021081f6f3044b68ab16bc7a2fa54a42)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:48.086165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428552c9-9787-475c-80b7-5c0b0e247586 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:48.086165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 217/415] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:47 2022] GET /identity/v3/groups/021081f6f3044b68ab16bc7a2fa54a42 => generated 229 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:48.092069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70477634-e2f9-4f6e-a8ba-0318b8225c6f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:48.170647 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:48.219715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70477634-e2f9-4f6e-a8ba-0318b8225c6f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:48.266291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f476e1-8592-4c63-aea6-7e80b74b4fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:48.272449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f476e1-8592-4c63-aea6-7e80b74b4fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.272449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f476e1-8592-4c63-aea6-7e80b74b4fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.272449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f476e1-8592-4c63-aea6-7e80b74b4fb7 None admin] PATH_INFO: `/v3/projects/2a24cdfa264d45f188d3bf7cc23a9da7` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.273680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f476e1-8592-4c63-aea6-7e80b74b4fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=2a24cdfa264d45f188d3bf7cc23a9da7)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:48.275143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f476e1-8592-4c63-aea6-7e80b74b4fb7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:48.277208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 199/416] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:48 2022] GET /identity/v3/projects/2a24cdfa264d45f188d3bf7cc23a9da7 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:48.282675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428552c9-9787-475c-80b7-5c0b0e247586 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:48.302055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f476e1-8592-4c63-aea6-7e80b74b4fb7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:48.412389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f476e1-8592-4c63-aea6-7e80b74b4fb7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:48.438903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:48.451224 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853517b-1b1a-44d0-b20f-dd8857236c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:48.452108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853517b-1b1a-44d0-b20f-dd8857236c5f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.452357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853517b-1b1a-44d0-b20f-dd8857236c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.457643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853517b-1b1a-44d0-b20f-dd8857236c5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.457762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428552c9-9787-475c-80b7-5c0b0e247586 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:48.465895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853517b-1b1a-44d0-b20f-dd8857236c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-6853517b-1b1a-44d0-b20f-dd8857236c5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:48.470875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:48.471832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:48.472636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 200/417] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:48.478340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853517b-1b1a-44d0-b20f-dd8857236c5f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:48.500282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b93b1-9fcc-472c-95f4-1c404e195780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:48.501446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b93b1-9fcc-472c-95f4-1c404e195780 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.501879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b93b1-9fcc-472c-95f4-1c404e195780 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.502319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b93b1-9fcc-472c-95f4-1c404e195780 None admin] PATH_INFO: `/v3/projects/2a24cdfa264d45f188d3bf7cc23a9da7/groups/021081f6f3044b68ab16bc7a2fa54a42/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.504660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b93b1-9fcc-472c-95f4-1c404e195780 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a24cdfa264d45f188d3bf7cc23a9da7, group_id=021081f6f3044b68ab16bc7a2fa54a42, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:48.506446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b93b1-9fcc-472c-95f4-1c404e195780 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:48.578425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 218/418] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 17 16:05:48 2022] PUT /identity/v3/projects/2a24cdfa264d45f188d3bf7cc23a9da7/groups/021081f6f3044b68ab16bc7a2fa54a42/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:48.590139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853517b-1b1a-44d0-b20f-dd8857236c5f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:48.629373 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb8038-ddb3-496b-95ac-6914000751b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:48.630114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb8038-ddb3-496b-95ac-6914000751b2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.630633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb8038-ddb3-496b-95ac-6914000751b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.630902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb8038-ddb3-496b-95ac-6914000751b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.631566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb8038-ddb3-496b-95ac-6914000751b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:48.631866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb8038-ddb3-496b-95ac-6914000751b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:48.633235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb8038-ddb3-496b-95ac-6914000751b2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:48.642390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 201/419] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:48.648055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b93b1-9fcc-472c-95f4-1c404e195780 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:48.737049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:48.801471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b93b1-9fcc-472c-95f4-1c404e195780 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:48.871712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cb8a7-2965-4215-bfcb-36c122836248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:48.871954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b30c-233d-472b-9154-f3b50f7da997 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.872363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb8a7-2965-4215-bfcb-36c122836248 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.872437 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b30c-233d-472b-9154-f3b50f7da997 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.872503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb8a7-2965-4215-bfcb-36c122836248 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.872570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b30c-233d-472b-9154-f3b50f7da997 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.872656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb8a7-2965-4215-bfcb-36c122836248 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.874072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 202/420] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:48.880183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912859-e938-4a68-9fe5-d992fbfd6862 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.880744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912859-e938-4a68-9fe5-d992fbfd6862 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.886755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912859-e938-4a68-9fe5-d992fbfd6862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.916831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-00912859-e938-4a68-9fe5-d992fbfd6862 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:48.919090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-00912859-e938-4a68-9fe5-d992fbfd6862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:48.984439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cb8a7-2965-4215-bfcb-36c122836248 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:48.986028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cb8a7-2965-4215-bfcb-36c122836248 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:49.021543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:49.072021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 203/421] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:49.077388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85df4aa-63fa-4464-bfba-5819ec1d336b None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.077388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85df4aa-63fa-4464-bfba-5819ec1d336b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.077388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85df4aa-63fa-4464-bfba-5819ec1d336b None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.077388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 204/422] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:49.083125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:49.084671 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf09886-bf6f-4b3f-9ec9-6dc811256f1c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.084945 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf09886-bf6f-4b3f-9ec9-6dc811256f1c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.085208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf09886-bf6f-4b3f-9ec9-6dc811256f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.135087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-fdf09886-bf6f-4b3f-9ec9-6dc811256f1c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:49.137834 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fdf09886-bf6f-4b3f-9ec9-6dc811256f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:49.190796 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 219/423] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:49.195014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cb8a7-2965-4215-bfcb-36c122836248 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.293516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 205/424] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:49.363474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cb8a7-2965-4215-bfcb-36c122836248 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:49.416211 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d6cf1-9f11-46c2-b15b-55e23d80cb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:49.418050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6cf1-9f11-46c2-b15b-55e23d80cb7e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.418639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6cf1-9f11-46c2-b15b-55e23d80cb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.419112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6cf1-9f11-46c2-b15b-55e23d80cb7e None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.426053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d6cf1-9f11-46c2-b15b-55e23d80cb7e None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:49.427725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d6cf1-9f11-46c2-b15b-55e23d80cb7e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:49.429924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 220/425] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:49 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:49.435762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf09886-bf6f-4b3f-9ec9-6dc811256f1c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.466853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d6cf1-9f11-46c2-b15b-55e23d80cb7e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.495919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:49.610503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d6cf1-9f11-46c2-b15b-55e23d80cb7e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:49.613548 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf09886-bf6f-4b3f-9ec9-6dc811256f1c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:49.621597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:49.655409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78b988-d0c9-462d-b048-6635f00499ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:49.656042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78b988-d0c9-462d-b048-6635f00499ef None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.656314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78b988-d0c9-462d-b048-6635f00499ef None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.656575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78b988-d0c9-462d-b048-6635f00499ef None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.657804 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78b988-d0c9-462d-b048-6635f00499ef None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:49.659395 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78b988-d0c9-462d-b048-6635f00499ef None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:49.668089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 206/426] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:49 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:49.669280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78b988-d0c9-462d-b048-6635f00499ef None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.672300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1efb-6288-4da2-980d-d6ac92b297a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:49.673185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1efb-6288-4da2-980d-d6ac92b297a7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.673691 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1efb-6288-4da2-980d-d6ac92b297a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.674179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a1efb-6288-4da2-980d-d6ac92b297a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.685357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a1efb-6288-4da2-980d-d6ac92b297a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8f5a1efb-6288-4da2-980d-d6ac92b297a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:49.690539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:49.691427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:49.692227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:49.694737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 221/427] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:49.704529 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1efb-6288-4da2-980d-d6ac92b297a7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.795438 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:49.811733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a1efb-6288-4da2-980d-d6ac92b297a7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:49.831305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78b988-d0c9-462d-b048-6635f00499ef None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:49.862006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39313c25-60ea-4e3b-b091-0bbf888dd9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:49.863307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313c25-60ea-4e3b-b091-0bbf888dd9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.864074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313c25-60ea-4e3b-b091-0bbf888dd9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.864949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313c25-60ea-4e3b-b091-0bbf888dd9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.866143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39313c25-60ea-4e3b-b091-0bbf888dd9f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:49.866754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39313c25-60ea-4e3b-b091-0bbf888dd9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:49.868557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39313c25-60ea-4e3b-b091-0bbf888dd9f1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:49.869434 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28b690-fdf1-4b95-b3f1-c8dae3c5869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:49.870120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28b690-fdf1-4b95-b3f1-c8dae3c5869f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.870420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28b690-fdf1-4b95-b3f1-c8dae3c5869f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.870755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28b690-fdf1-4b95-b3f1-c8dae3c5869f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.871472 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28b690-fdf1-4b95-b3f1-c8dae3c5869f None admin] RBAC: Adding query filter params (group.id=0a904516031649ffb237da697e70cadb, role.id=a64cd92139fb4f1fb64f05f5a88f999f, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:49.871771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28b690-fdf1-4b95-b3f1-c8dae3c5869f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:49.873186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28b690-fdf1-4b95-b3f1-c8dae3c5869f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:49.879768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 207/428] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 17 16:05:49 2022] GET /identity/v3/role_assignments?group.id=0a904516031649ffb237da697e70cadb&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:49.880645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28b690-fdf1-4b95-b3f1-c8dae3c5869f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.892404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 222/429] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:49.893633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39313c25-60ea-4e3b-b091-0bbf888dd9f1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.936070 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:50.024519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39313c25-60ea-4e3b-b091-0bbf888dd9f1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:50.026909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28b690-fdf1-4b95-b3f1-c8dae3c5869f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:50.065247 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cdff0-f10a-474b-8de1-345dfe7bf734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:50.065903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cdff0-f10a-474b-8de1-345dfe7bf734 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:50.066173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cdff0-f10a-474b-8de1-345dfe7bf734 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:50.066765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cdff0-f10a-474b-8de1-345dfe7bf734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:50.087459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5f72b-e883-4141-a84d-38f9c1c1af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:50.088115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5f72b-e883-4141-a84d-38f9c1c1af39 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:50.088386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5f72b-e883-4141-a84d-38f9c1c1af39 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:50.089283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5f72b-e883-4141-a84d-38f9c1c1af39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:50.096542 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:50.115536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5f72b-e883-4141-a84d-38f9c1c1af39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-54e5f72b-e883-4141-a84d-38f9c1c1af39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:50.121729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:50.122704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:50.123491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 208/430] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:50.130529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5f72b-e883-4141-a84d-38f9c1c1af39 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:50.186303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cdff0-f10a-474b-8de1-345dfe7bf734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:50.188145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cdff0-f10a-474b-8de1-345dfe7bf734 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:50.260416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:50.265493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5f72b-e883-4141-a84d-38f9c1c1af39 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:50.303753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dccdb4-4fb2-4637-99eb-c318b0e2e504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:50.304364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dccdb4-4fb2-4637-99eb-c318b0e2e504 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:50.304638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dccdb4-4fb2-4637-99eb-c318b0e2e504 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:50.304903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dccdb4-4fb2-4637-99eb-c318b0e2e504 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:50.305587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dccdb4-4fb2-4637-99eb-c318b0e2e504 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:50.305883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dccdb4-4fb2-4637-99eb-c318b0e2e504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:50.308004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dccdb4-4fb2-4637-99eb-c318b0e2e504 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:50.311303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 223/431] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:50.312636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd0885-93f2-4647-a4db-5051f36ce2a0 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:50.312915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd0885-93f2-4647-a4db-5051f36ce2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:50.313188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd0885-93f2-4647-a4db-5051f36ce2a0 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:50.314702 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 224/432] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:50.317056 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 209/433] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:05:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:50.319816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3262a-7edf-468e-b90d-40799c67146b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:50.320099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3262a-7edf-468e-b90d-40799c67146b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:50.320369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3262a-7edf-468e-b90d-40799c67146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:50.322542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dccdb4-4fb2-4637-99eb-c318b0e2e504 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:50.339312 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-39e3262a-7edf-468e-b90d-40799c67146b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:50.340523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-39e3262a-7edf-468e-b90d-40799c67146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:50.387401 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:50.419472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 225/434] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:50.420319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3262a-7edf-468e-b90d-40799c67146b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:50.443171 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dccdb4-4fb2-4637-99eb-c318b0e2e504 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:50.482937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc13cf-f8c5-42aa-a52d-d429c912c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:50.483952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc13cf-f8c5-42aa-a52d-d429c912c9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:50.484459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc13cf-f8c5-42aa-a52d-d429c912c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:50.484934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc13cf-f8c5-42aa-a52d-d429c912c9a8 None admin] PATH_INFO: `/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:50.486273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc13cf-f8c5-42aa-a52d-d429c912c9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6f6d4571bf4ceeb09359528c51bbad)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:50.487793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc13cf-f8c5-42aa-a52d-d429c912c9a8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:50.490843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 210/435] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:50 2022] GET /identity/v3/projects/9f6f6d4571bf4ceeb09359528c51bbad => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:50.497306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc13cf-f8c5-42aa-a52d-d429c912c9a8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:50.536736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:50.568861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3262a-7edf-468e-b90d-40799c67146b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:50.615045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f0b3f-0038-4da8-b8bd-9be3c5b8e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:50.615818 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f0b3f-0038-4da8-b8bd-9be3c5b8e052 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:50.616139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f0b3f-0038-4da8-b8bd-9be3c5b8e052 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:50.616478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f0b3f-0038-4da8-b8bd-9be3c5b8e052 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:50.632973 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc13cf-f8c5-42aa-a52d-d429c912c9a8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:50.672145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:50.677522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331f96-2259-466a-bd3d-053902f7443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:50.678690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331f96-2259-466a-bd3d-053902f7443c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:50.682853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331f96-2259-466a-bd3d-053902f7443c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:50.682853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331f96-2259-466a-bd3d-053902f7443c None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:50.682853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c331f96-2259-466a-bd3d-053902f7443c None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:50.683271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c331f96-2259-466a-bd3d-053902f7443c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:50.685445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 211/436] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:50 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:50.691430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331f96-2259-466a-bd3d-053902f7443c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:50.709441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f0b3f-0038-4da8-b8bd-9be3c5b8e052 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:50.711088 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f0b3f-0038-4da8-b8bd-9be3c5b8e052 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:50.802758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:50.809460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331f96-2259-466a-bd3d-053902f7443c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:50.818416 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 226/437] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:05:50.820260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f0b3f-0038-4da8-b8bd-9be3c5b8e052 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:50.849661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8450301-0416-43f9-8d43-879286fcd7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:50.850495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8450301-0416-43f9-8d43-879286fcd7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:50.850916 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8450301-0416-43f9-8d43-879286fcd7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:50.851327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8450301-0416-43f9-8d43-879286fcd7e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:50.852229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8450301-0416-43f9-8d43-879286fcd7e4 None admin] RBAC: Adding query filter params (group.id=0a904516031649ffb237da697e70cadb, role.id=68da777efbc34e15a79e851577a8ee89, scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:50.852536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8450301-0416-43f9-8d43-879286fcd7e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:50.854666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8450301-0416-43f9-8d43-879286fcd7e4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:50.861436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 212/438] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 17 16:05:50 2022] GET /identity/v3/role_assignments?group.id=0a904516031649ffb237da697e70cadb&scope.project.id=9f6f6d4571bf4ceeb09359528c51bbad&role.id=68da777efbc34e15a79e851577a8ee89 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:50.862108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8450301-0416-43f9-8d43-879286fcd7e4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:50.934554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:50.963982 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f0b3f-0038-4da8-b8bd-9be3c5b8e052 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:51.005122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347c27d-2386-4a57-aeb9-92b28aa5168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:51.005864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347c27d-2386-4a57-aeb9-92b28aa5168a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.006143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347c27d-2386-4a57-aeb9-92b28aa5168a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.006417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347c27d-2386-4a57-aeb9-92b28aa5168a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.007320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8450301-0416-43f9-8d43-879286fcd7e4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:51.019931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347c27d-2386-4a57-aeb9-92b28aa5168a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9347c27d-2386-4a57-aeb9-92b28aa5168a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:51.026592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:51.027591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:51.028403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 227/439] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:51.029061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7a60-ef0f-443d-9ca0-32ff6fd8d4cd None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.029061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7a60-ef0f-443d-9ca0-32ff6fd8d4cd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.029061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7a60-ef0f-443d-9ca0-32ff6fd8d4cd None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.030638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 228/440] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:51.035072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f7a60-ef0f-443d-9ca0-32ff6fd8d4cd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:51.055910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ab74b-5613-4a7c-a851-1d39b0ea2ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:51.056545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ab74b-5613-4a7c-a851-1d39b0ea2ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.056824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ab74b-5613-4a7c-a851-1d39b0ea2ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.057106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ab74b-5613-4a7c-a851-1d39b0ea2ed2 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.058634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ab74b-5613-4a7c-a851-1d39b0ea2ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:51.060092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ab74b-5613-4a7c-a851-1d39b0ea2ed2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:51.061943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 213/441] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:50 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:51.062880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e75f14-6d42-4782-96fb-43f4d42c5125 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.063166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e75f14-6d42-4782-96fb-43f4d42c5125 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.063434 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e75f14-6d42-4782-96fb-43f4d42c5125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.082090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d2e75f14-6d42-4782-96fb-43f4d42c5125 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:51.083935 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d2e75f14-6d42-4782-96fb-43f4d42c5125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:51.114663 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:51.163092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f7a60-ef0f-443d-9ca0-32ff6fd8d4cd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:51.172395 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 214/442] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:51.173239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e75f14-6d42-4782-96fb-43f4d42c5125 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:51.210752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dbb22-a280-4753-88e7-1fef70668276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:51.211370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dbb22-a280-4753-88e7-1fef70668276 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.211650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dbb22-a280-4753-88e7-1fef70668276 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.211925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dbb22-a280-4753-88e7-1fef70668276 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.212599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000dbb22-a280-4753-88e7-1fef70668276 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:51.212900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000dbb22-a280-4753-88e7-1fef70668276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:51.214914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000dbb22-a280-4753-88e7-1fef70668276 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:51.218262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:51.231558 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 229/443] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:51.233751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dbb22-a280-4753-88e7-1fef70668276 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:51.303544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e75f14-6d42-4782-96fb-43f4d42c5125 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:51.341714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16416159-eb73-4d80-aadc-028584049ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:51.342343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16416159-eb73-4d80-aadc-028584049ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.342620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16416159-eb73-4d80-aadc-028584049ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.342892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16416159-eb73-4d80-aadc-028584049ca7 None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.344005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16416159-eb73-4d80-aadc-028584049ca7 None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:51.345454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16416159-eb73-4d80-aadc-028584049ca7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:51.347180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 215/444] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:51 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:51.351361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dbb22-a280-4753-88e7-1fef70668276 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:51.352776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16416159-eb73-4d80-aadc-028584049ca7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:51.384283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:51.389332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d793-8372-4b44-80d1-bffdc25041aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:51.389990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d793-8372-4b44-80d1-bffdc25041aa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.390270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d793-8372-4b44-80d1-bffdc25041aa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.390539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d793-8372-4b44-80d1-bffdc25041aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.462217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:51.465949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d793-8372-4b44-80d1-bffdc25041aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:51.466656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16416159-eb73-4d80-aadc-028584049ca7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:51.467403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d793-8372-4b44-80d1-bffdc25041aa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:51.501830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212339f9-485b-4531-8298-bab08da0d1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:51.502448 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212339f9-485b-4531-8298-bab08da0d1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.502700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212339f9-485b-4531-8298-bab08da0d1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.502965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212339f9-485b-4531-8298-bab08da0d1e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.503672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212339f9-485b-4531-8298-bab08da0d1e9 None admin] RBAC: Adding query filter params (group.id=0a904516031649ffb237da697e70cadb, role.id=a64cd92139fb4f1fb64f05f5a88f999f, scope.project.id=cd7db93d6ee541a491174595f83a43ef) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:51.503970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212339f9-485b-4531-8298-bab08da0d1e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:51.505411 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212339f9-485b-4531-8298-bab08da0d1e9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:51.511082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 216/445] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 17 16:05:51 2022] GET /identity/v3/role_assignments?group.id=0a904516031649ffb237da697e70cadb&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=a64cd92139fb4f1fb64f05f5a88f999f => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:51.518727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212339f9-485b-4531-8298-bab08da0d1e9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:51.586326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 230/446] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:05:51.592491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d793-8372-4b44-80d1-bffdc25041aa None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:51.618977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:51.629912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212339f9-485b-4531-8298-bab08da0d1e9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:51.671511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc83c1-74c5-4522-9554-87ab8a381fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:51.672152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc83c1-74c5-4522-9554-87ab8a381fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.672422 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc83c1-74c5-4522-9554-87ab8a381fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.672693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc83c1-74c5-4522-9554-87ab8a381fc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.688852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc83c1-74c5-4522-9554-87ab8a381fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-d3cc83c1-74c5-4522-9554-87ab8a381fc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:51.692147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:51.693076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:51.694002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 217/447] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:51.699861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc83c1-74c5-4522-9554-87ab8a381fc1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:51.706694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:51.710766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d793-8372-4b44-80d1-bffdc25041aa None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:51.752308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707f34a-6c7f-48ea-a75a-a662cb5baf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:51.752867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f34a-6c7f-48ea-a75a-a662cb5baf40 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.753143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f34a-6c7f-48ea-a75a-a662cb5baf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.753446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f34a-6c7f-48ea-a75a-a662cb5baf40 None admin] PATH_INFO: `/v3/projects/cd7db93d6ee541a491174595f83a43ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.754605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707f34a-6c7f-48ea-a75a-a662cb5baf40 None admin] RBAC: Authorizing `identity:get_project(project_id=cd7db93d6ee541a491174595f83a43ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:51.756018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707f34a-6c7f-48ea-a75a-a662cb5baf40 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:51.757864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 231/448] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:51 2022] GET /identity/v3/projects/cd7db93d6ee541a491174595f83a43ef => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:51.763284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707f34a-6c7f-48ea-a75a-a662cb5baf40 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:51.827757 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc83c1-74c5-4522-9554-87ab8a381fc1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:51.868379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc70cc-f602-4adb-8ee5-10e53ae1ac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:51.868989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc70cc-f602-4adb-8ee5-10e53ae1ac3f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.869261 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc70cc-f602-4adb-8ee5-10e53ae1ac3f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.869714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc70cc-f602-4adb-8ee5-10e53ae1ac3f None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.870378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc70cc-f602-4adb-8ee5-10e53ae1ac3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:51.872477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc70cc-f602-4adb-8ee5-10e53ae1ac3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:51.872477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc70cc-f602-4adb-8ee5-10e53ae1ac3f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:51.880677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 218/449] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:51.886349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc70cc-f602-4adb-8ee5-10e53ae1ac3f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:51.886983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707f34a-6c7f-48ea-a75a-a662cb5baf40 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:51.902237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:51.922155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430ba84-6c75-43e5-8026-3ef441c9f939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:51.922813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ba84-6c75-43e5-8026-3ef441c9f939 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:51.923087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ba84-6c75-43e5-8026-3ef441c9f939 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:51.923356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430ba84-6c75-43e5-8026-3ef441c9f939 None admin] PATH_INFO: `/v3/groups/0a904516031649ffb237da697e70cadb` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:51.924461 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430ba84-6c75-43e5-8026-3ef441c9f939 None admin] RBAC: Authorizing `identity:get_group(group_id=0a904516031649ffb237da697e70cadb)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:51.925948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430ba84-6c75-43e5-8026-3ef441c9f939 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:51.927808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 232/450] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:51 2022] GET /identity/v3/groups/0a904516031649ffb237da697e70cadb => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:51.933290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430ba84-6c75-43e5-8026-3ef441c9f939 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:51.967977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:51.988775 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc70cc-f602-4adb-8ee5-10e53ae1ac3f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:52.022030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09df334-8696-4d83-a354-bff564888511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:52.022646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09df334-8696-4d83-a354-bff564888511 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.022825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09df334-8696-4d83-a354-bff564888511 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.023095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09df334-8696-4d83-a354-bff564888511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.032902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430ba84-6c75-43e5-8026-3ef441c9f939 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:52.066769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4519ff-b778-40af-8915-30211535af77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:52.067361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4519ff-b778-40af-8915-30211535af77 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.067641 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4519ff-b778-40af-8915-30211535af77 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.067932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4519ff-b778-40af-8915-30211535af77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.068648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4519ff-b778-40af-8915-30211535af77 None admin] RBAC: Adding query filter params (group.id=0a904516031649ffb237da697e70cadb, role.id=68da777efbc34e15a79e851577a8ee89, scope.project.id=cd7db93d6ee541a491174595f83a43ef) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:52.068952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4519ff-b778-40af-8915-30211535af77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:52.070417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4519ff-b778-40af-8915-30211535af77 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:52.077003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 233/451] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 17 16:05:51 2022] GET /identity/v3/role_assignments?group.id=0a904516031649ffb237da697e70cadb&scope.project.id=cd7db93d6ee541a491174595f83a43ef&role.id=68da777efbc34e15a79e851577a8ee89 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:52.093974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09df334-8696-4d83-a354-bff564888511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:52.095469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09df334-8696-4d83-a354-bff564888511 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:52.110559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:52.201821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 219/452] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:05:52.207823 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4519ff-b778-40af-8915-30211535af77 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:52.306586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:52.310537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4519ff-b778-40af-8915-30211535af77 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:52.348776 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3aaa0-87a1-4555-9f6a-7447234a3ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:52.349423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3aaa0-87a1-4555-9f6a-7447234a3ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.351695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3aaa0-87a1-4555-9f6a-7447234a3ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.351695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3aaa0-87a1-4555-9f6a-7447234a3ae7 None admin] PATH_INFO: `/v3/projects/2a24cdfa264d45f188d3bf7cc23a9da7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.351695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3aaa0-87a1-4555-9f6a-7447234a3ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=2a24cdfa264d45f188d3bf7cc23a9da7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:52.352509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3aaa0-87a1-4555-9f6a-7447234a3ae7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:52.354226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 234/453] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:05:52 2022] GET /identity/v3/projects/2a24cdfa264d45f188d3bf7cc23a9da7 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:52.360022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09df334-8696-4d83-a354-bff564888511 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:52.458862 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09df334-8696-4d83-a354-bff564888511 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:52.471878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:52.491784 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9a280-6b67-418f-a9d1-fc3ad3e4d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:52.495178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9a280-6b67-418f-a9d1-fc3ad3e4d25a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.495178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9a280-6b67-418f-a9d1-fc3ad3e4d25a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.495178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9a280-6b67-418f-a9d1-fc3ad3e4d25a None admin] PATH_INFO: `/v3/groups/021081f6f3044b68ab16bc7a2fa54a42` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.495178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9a280-6b67-418f-a9d1-fc3ad3e4d25a None admin] RBAC: Authorizing `identity:get_group(group_id=021081f6f3044b68ab16bc7a2fa54a42)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:52.496236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9a280-6b67-418f-a9d1-fc3ad3e4d25a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:52.497820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 220/454] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 17 16:05:52 2022] GET /identity/v3/groups/021081f6f3044b68ab16bc7a2fa54a42 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:52.503770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3aaa0-87a1-4555-9f6a-7447234a3ae7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:52.600280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3aaa0-87a1-4555-9f6a-7447234a3ae7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:52.633000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aefbb-8031-4229-a02d-03924ac4d183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:52.633625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aefbb-8031-4229-a02d-03924ac4d183 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.633901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aefbb-8031-4229-a02d-03924ac4d183 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.634168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aefbb-8031-4229-a02d-03924ac4d183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.634883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aefbb-8031-4229-a02d-03924ac4d183 None admin] RBAC: Adding query filter params (group.id=021081f6f3044b68ab16bc7a2fa54a42, role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=2a24cdfa264d45f188d3bf7cc23a9da7) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:52.635184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aefbb-8031-4229-a02d-03924ac4d183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:52.637405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aefbb-8031-4229-a02d-03924ac4d183 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:52.643009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 235/455] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 17 16:05:52 2022] GET /identity/v3/role_assignments?group.id=021081f6f3044b68ab16bc7a2fa54a42&scope.project.id=2a24cdfa264d45f188d3bf7cc23a9da7&role.id=28beda93f70d4c549352145ddee01aac => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:54.952402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80032d97-d448-42b7-a043-3e010b4ca2de None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:54.953252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80032d97-d448-42b7-a043-3e010b4ca2de None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:54.953707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80032d97-d448-42b7-a043-3e010b4ca2de None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:54.955393 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 221/456] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:54.960812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060ccd-6526-40e2-8bc0-7ef0b585ffdf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:54.975398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060ccd-6526-40e2-8bc0-7ef0b585ffdf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:54.975398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060ccd-6526-40e2-8bc0-7ef0b585ffdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:54.986405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-48060ccd-6526-40e2-8bc0-7ef0b585ffdf None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:54.989242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-48060ccd-6526-40e2-8bc0-7ef0b585ffdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:55.022251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:55.083659 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 236/457] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:55.150111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8406-7af6-47d0-a4ee-1efb146a909a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.150380 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8406-7af6-47d0-a4ee-1efb146a909a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.150940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8406-7af6-47d0-a4ee-1efb146a909a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.152696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 222/458] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:55.158190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948c36e-631b-4a52-9041-8ab685ddd3d1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.158695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948c36e-631b-4a52-9041-8ab685ddd3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.159160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948c36e-631b-4a52-9041-8ab685ddd3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.186346 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5948c36e-631b-4a52-9041-8ab685ddd3d1 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:55.187855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5948c36e-631b-4a52-9041-8ab685ddd3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:55.280678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 237/459] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:55.352914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8ef08-c715-4914-b1b7-25ff4668f7eb None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.353554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8ef08-c715-4914-b1b7-25ff4668f7eb None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.354567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8ef08-c715-4914-b1b7-25ff4668f7eb None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.356387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 223/460] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:55.361245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208505ad-7013-4378-90cb-569eb3248785 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.361561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208505ad-7013-4378-90cb-569eb3248785 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.361821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208505ad-7013-4378-90cb-569eb3248785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.390594 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-208505ad-7013-4378-90cb-569eb3248785 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:55.391778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-208505ad-7013-4378-90cb-569eb3248785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:55.436411 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8ef08-c715-4914-b1b7-25ff4668f7eb None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:55.519764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 238/461] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:55.590481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8ef08-c715-4914-b1b7-25ff4668f7eb None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:55.591687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208505ad-7013-4378-90cb-569eb3248785 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:55.616171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:55.651416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1274-9b5d-4088-9352-4d16d2a6a168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:55.652058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1274-9b5d-4088-9352-4d16d2a6a168 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.652333 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1274-9b5d-4088-9352-4d16d2a6a168 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.652603 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1274-9b5d-4088-9352-4d16d2a6a168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.679339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d1274-9b5d-4088-9352-4d16d2a6a168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:55.680883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d1274-9b5d-4088-9352-4d16d2a6a168 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:55.706362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208505ad-7013-4378-90cb-569eb3248785 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-6d7d1274-9b5d-4088-9352-4d16d2a6a168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:55.710745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:55.711630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:55.712465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:55.712465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:55.712465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:55.712465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 224/462] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:55.719252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1274-9b5d-4088-9352-4d16d2a6a168 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:55.746300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e71783-c633-4eeb-88f0-5d6fdeee347c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:55.747367 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e71783-c633-4eeb-88f0-5d6fdeee347c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.747871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e71783-c633-4eeb-88f0-5d6fdeee347c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.748338 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e71783-c633-4eeb-88f0-5d6fdeee347c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.757225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:55.761169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e71783-c633-4eeb-88f0-5d6fdeee347c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:55.762883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e71783-c633-4eeb-88f0-5d6fdeee347c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f9e71783-c633-4eeb-88f0-5d6fdeee347c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:55.778883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:55.779820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:55.780674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:55.780674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:55.780674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:55.782464 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 239/463] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:55.783978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe897deb-b482-4250-87d8-f0fa08c55c26 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.784488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe897deb-b482-4250-87d8-f0fa08c55c26 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.785064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe897deb-b482-4250-87d8-f0fa08c55c26 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.786980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 240/464] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:55.788585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe897deb-b482-4250-87d8-f0fa08c55c26 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:55.839209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1274-9b5d-4088-9352-4d16d2a6a168 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:55.866948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:55.876169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df070bf-3174-4669-8094-7940508fb342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:55.879012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df070bf-3174-4669-8094-7940508fb342 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.879012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df070bf-3174-4669-8094-7940508fb342 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.879012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df070bf-3174-4669-8094-7940508fb342 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.879012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df070bf-3174-4669-8094-7940508fb342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:55.879012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df070bf-3174-4669-8094-7940508fb342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:55.879816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df070bf-3174-4669-8094-7940508fb342 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:55.895064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 225/465] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:55.896528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30d605-df07-4dc6-bdcb-9ec78a6e1a73 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.897018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30d605-df07-4dc6-bdcb-9ec78a6e1a73 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.897543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30d605-df07-4dc6-bdcb-9ec78a6e1a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.904579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe897deb-b482-4250-87d8-f0fa08c55c26 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:55.915604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7d30d605-df07-4dc6-bdcb-9ec78a6e1a73 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:55.917324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7d30d605-df07-4dc6-bdcb-9ec78a6e1a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:55.940925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224af923-6e77-4f17-a392-761d022a7b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:55.941585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224af923-6e77-4f17-a392-761d022a7b55 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.942112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224af923-6e77-4f17-a392-761d022a7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.942112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224af923-6e77-4f17-a392-761d022a7b55 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.942768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224af923-6e77-4f17-a392-761d022a7b55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:55.943069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224af923-6e77-4f17-a392-761d022a7b55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:55.944447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224af923-6e77-4f17-a392-761d022a7b55 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:55.957380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 241/466] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:55.958340 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224af923-6e77-4f17-a392-761d022a7b55 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:55.990029 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 226/467] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:55.999724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30d605-df07-4dc6-bdcb-9ec78a6e1a73 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:56.031200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:56.072772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224af923-6e77-4f17-a392-761d022a7b55 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.106578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:56.111947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406afd9-d0e5-44ba-8d0b-d459cd7da10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.112813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406afd9-d0e5-44ba-8d0b-d459cd7da10f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.113484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406afd9-d0e5-44ba-8d0b-d459cd7da10f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.113910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406afd9-d0e5-44ba-8d0b-d459cd7da10f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.126088 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406afd9-d0e5-44ba-8d0b-d459cd7da10f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.127953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30d605-df07-4dc6-bdcb-9ec78a6e1a73 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.128159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406afd9-d0e5-44ba-8d0b-d459cd7da10f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3406afd9-d0e5-44ba-8d0b-d459cd7da10f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:56.145806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:56.146744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:56.147629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:56.147629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:56.147629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:56.149500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 242/468] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:56.150403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406afd9-d0e5-44ba-8d0b-d459cd7da10f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:56.171215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570242f-82b3-47fb-8a1e-3705f7bb29ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.172200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570242f-82b3-47fb-8a1e-3705f7bb29ea None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.172655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570242f-82b3-47fb-8a1e-3705f7bb29ea None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.173115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570242f-82b3-47fb-8a1e-3705f7bb29ea None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.173959 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570242f-82b3-47fb-8a1e-3705f7bb29ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.175616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570242f-82b3-47fb-8a1e-3705f7bb29ea None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:56.255964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 227/469] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:55 2022] POST /identity/v3/users => generated 246 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:56.257425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570242f-82b3-47fb-8a1e-3705f7bb29ea None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:56.268837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406afd9-d0e5-44ba-8d0b-d459cd7da10f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.310308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125c26a-4393-4c11-8a0f-922a331e5281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.310997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125c26a-4393-4c11-8a0f-922a331e5281 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.311273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125c26a-4393-4c11-8a0f-922a331e5281 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.311544 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125c26a-4393-4c11-8a0f-922a331e5281 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.312199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125c26a-4393-4c11-8a0f-922a331e5281 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.313820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125c26a-4393-4c11-8a0f-922a331e5281 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:56.364504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:56.377674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 243/470] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:56 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:56.388214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125c26a-4393-4c11-8a0f-922a331e5281 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:56.412972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570242f-82b3-47fb-8a1e-3705f7bb29ea None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.451155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:56.465172 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6f3d9-8339-4bc3-8f97-77d713367459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.466236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6f3d9-8339-4bc3-8f97-77d713367459 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.468170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6f3d9-8339-4bc3-8f97-77d713367459 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.468680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6f3d9-8339-4bc3-8f97-77d713367459 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.469690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6f3d9-8339-4bc3-8f97-77d713367459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:56.470247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6f3d9-8339-4bc3-8f97-77d713367459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.471891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6f3d9-8339-4bc3-8f97-77d713367459 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:56.488901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 228/471] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:56.495916 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6f3d9-8339-4bc3-8f97-77d713367459 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:56.545507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125c26a-4393-4c11-8a0f-922a331e5281 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.598592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10584e9-5c07-4bdc-aae6-80a28004a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.599944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10584e9-5c07-4bdc-aae6-80a28004a048 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.600569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10584e9-5c07-4bdc-aae6-80a28004a048 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.601146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10584e9-5c07-4bdc-aae6-80a28004a048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.613191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10584e9-5c07-4bdc-aae6-80a28004a048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.614709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10584e9-5c07-4bdc-aae6-80a28004a048 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:56.629156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6f3d9-8339-4bc3-8f97-77d713367459 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d10584e9-5c07-4bdc-aae6-80a28004a048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:56.632241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:56.633284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:56.634168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:56.634168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:56.634168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:56.634168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 244/472] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:56.641501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10584e9-5c07-4bdc-aae6-80a28004a048 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:56.675925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a030f1f-310d-488f-94dc-d59ec2a92f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.676695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a030f1f-310d-488f-94dc-d59ec2a92f01 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.676973 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a030f1f-310d-488f-94dc-d59ec2a92f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.677242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a030f1f-310d-488f-94dc-d59ec2a92f01 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.678073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a030f1f-310d-488f-94dc-d59ec2a92f01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.680557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a030f1f-310d-488f-94dc-d59ec2a92f01 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:56.694868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:56.749089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:56.757562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10584e9-5c07-4bdc-aae6-80a28004a048 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.775267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 229/473] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:56 2022] POST /identity/v3/users => generated 248 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:56.776843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9973718-d273-4b86-8b1d-70a8c31cf0e1 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.777114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9973718-d273-4b86-8b1d-70a8c31cf0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.777404 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9973718-d273-4b86-8b1d-70a8c31cf0e1 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.779038 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 230/474] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:56.784850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9357e-8d6a-4d4e-a8c1-00f6a247f58c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.785129 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9357e-8d6a-4d4e-a8c1-00f6a247f58c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.785432 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9357e-8d6a-4d4e-a8c1-00f6a247f58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.800046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32584512-ebac-4b7a-9490-0d7454727431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.801261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32584512-ebac-4b7a-9490-0d7454727431 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.801584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32584512-ebac-4b7a-9490-0d7454727431 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.801925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32584512-ebac-4b7a-9490-0d7454727431 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.802956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32584512-ebac-4b7a-9490-0d7454727431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:56.811315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32584512-ebac-4b7a-9490-0d7454727431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.811315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32584512-ebac-4b7a-9490-0d7454727431 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:56.811502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-07b9357e-8d6a-4d4e-a8c1-00f6a247f58c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:56.811502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-07b9357e-8d6a-4d4e-a8c1-00f6a247f58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:56.829413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 245/475] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:56.832736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32584512-ebac-4b7a-9490-0d7454727431 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:56.958303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 231/476] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:57.023655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32584512-ebac-4b7a-9490-0d7454727431 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.060702 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9061f6-d7e6-4c79-a0f2-de6265619580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:57.061229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9061f6-d7e6-4c79-a0f2-de6265619580 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:57.061537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9061f6-d7e6-4c79-a0f2-de6265619580 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:57.061806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9061f6-d7e6-4c79-a0f2-de6265619580 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:57.062446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9061f6-d7e6-4c79-a0f2-de6265619580 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:57.063930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9061f6-d7e6-4c79-a0f2-de6265619580 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:57.149873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 246/477] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:56 2022] POST /identity/v3/users => generated 249 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:57.237527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9357e-8d6a-4d4e-a8c1-00f6a247f58c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:57.369675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9357e-8d6a-4d4e-a8c1-00f6a247f58c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.396959 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:57.408074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989be330-83eb-41d8-bc19-7f9c6c92bb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:57.408687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989be330-83eb-41d8-bc19-7f9c6c92bb51 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:57.408956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989be330-83eb-41d8-bc19-7f9c6c92bb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:57.409213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989be330-83eb-41d8-bc19-7f9c6c92bb51 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:57.409907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989be330-83eb-41d8-bc19-7f9c6c92bb51 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:57.411264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989be330-83eb-41d8-bc19-7f9c6c92bb51 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:57.463879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.sql.core [None req-989be330-83eb-41d8-bc19-7f9c6c92bb51 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 16:05:57.463879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 16:05:57.463879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [parameters: {'id': 'c9c20ab69e904d2681581bf0db391e77', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 16:05:57.463879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81777) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-989be330-83eb-41d8-bc19-7f9c6c92bb51 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result.read() Aug 17 16:05:57.479802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return ref.to_dict() Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:05:57.480745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application yield resource Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise self.value Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application session.commit() Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 16:05:57.482065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.session.flush() Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application compat.raise_( Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 16:05:57.482954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:05:57.484481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result.read() Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:05:57.486596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [parameters: {'id': 'c9c20ab69e904d2681581bf0db391e77', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:57.488345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 16:05:57.493633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:57.495741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 232/478] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 17 16:05:57 2022] POST /identity/v3/roles => generated 144 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:57.496860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9061f6-d7e6-4c79-a0f2-de6265619580 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:57.507449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:57.607945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9061f6-d7e6-4c79-a0f2-de6265619580 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.647583 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795dfb9-79e8-42cc-a0cf-23bfac8d3ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:57.648171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795dfb9-79e8-42cc-a0cf-23bfac8d3ebe None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:57.648453 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795dfb9-79e8-42cc-a0cf-23bfac8d3ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:57.648723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795dfb9-79e8-42cc-a0cf-23bfac8d3ebe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:57.664498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795dfb9-79e8-42cc-a0cf-23bfac8d3ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0795dfb9-79e8-42cc-a0cf-23bfac8d3ebe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:57.669706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:57.670593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:57.671386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 247/479] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:05:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:57.676588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989be330-83eb-41d8-bc19-7f9c6c92bb51 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:57.808600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989be330-83eb-41d8-bc19-7f9c6c92bb51 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.853921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fdb7a-387c-4929-be4c-a3a610bd6052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:57.854624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fdb7a-387c-4929-be4c-a3a610bd6052 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:57.854899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fdb7a-387c-4929-be4c-a3a610bd6052 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:57.855175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fdb7a-387c-4929-be4c-a3a610bd6052 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:57.855835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fdb7a-387c-4929-be4c-a3a610bd6052 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:57.856134 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fdb7a-387c-4929-be4c-a3a610bd6052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:57.857546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fdb7a-387c-4929-be4c-a3a610bd6052 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:57.866132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 233/480] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:58.714585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34d51b-1d99-4355-9dfa-76a966ac86ec None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:58.715106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34d51b-1d99-4355-9dfa-76a966ac86ec None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:58.715106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34d51b-1d99-4355-9dfa-76a966ac86ec None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:58.716525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 248/481] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:58.726646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a5b5-5377-4e15-8976-3f263019f016 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:58.727080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a5b5-5377-4e15-8976-3f263019f016 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:58.727183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487a5b5-5377-4e15-8976-3f263019f016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:58.750143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e487a5b5-5377-4e15-8976-3f263019f016 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:58.751328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e487a5b5-5377-4e15-8976-3f263019f016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:58.786146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a968662-9725-40dd-b0d3-e92fe8f28204 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:58.786446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a968662-9725-40dd-b0d3-e92fe8f28204 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:58.786700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a968662-9725-40dd-b0d3-e92fe8f28204 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:58.788355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 249/482] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:58.793719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4e4c-c498-4b02-bebe-67460418706c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:58.794003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4e4c-c498-4b02-bebe-67460418706c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:58.794281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4e4c-c498-4b02-bebe-67460418706c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:58.802119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:58.838913 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-724f4e4c-c498-4b02-bebe-67460418706c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:58.840118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-724f4e4c-c498-4b02-bebe-67460418706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:58.844454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 234/483] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:58.948886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:58.954391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 250/484] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:05:59.058308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82de110-3d1e-4798-9d03-ef604da0d880 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.058539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82de110-3d1e-4798-9d03-ef604da0d880 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.058807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82de110-3d1e-4798-9d03-ef604da0d880 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.060326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 235/485] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:59.065132 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5307c0-3cf1-4f63-8103-0371eb67facd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.065439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5307c0-3cf1-4f63-8103-0371eb67facd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.065709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5307c0-3cf1-4f63-8103-0371eb67facd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.090269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9e5307c0-3cf1-4f63-8103-0371eb67facd None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:59.091442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9e5307c0-3cf1-4f63-8103-0371eb67facd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:59.187887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 251/486] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:05:59.270897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82de110-3d1e-4798-9d03-ef604da0d880 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:59.383995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5307c0-3cf1-4f63-8103-0371eb67facd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:59.387009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82de110-3d1e-4798-9d03-ef604da0d880 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:59.424892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3acff-6bf7-4175-ab5e-24f8bbb1b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:59.425573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3acff-6bf7-4175-ab5e-24f8bbb1b0ef None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.425858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3acff-6bf7-4175-ab5e-24f8bbb1b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.426133 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3acff-6bf7-4175-ab5e-24f8bbb1b0ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.439819 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3acff-6bf7-4175-ab5e-24f8bbb1b0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-edc3acff-6bf7-4175-ab5e-24f8bbb1b0ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:59.445077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:59.446277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:59.447086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 236/487] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:05:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:59.454013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3acff-6bf7-4175-ab5e-24f8bbb1b0ef None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:59.521843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:59.566569 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3acff-6bf7-4175-ab5e-24f8bbb1b0ef None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:59.606374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1162bb3-881f-4ed1-b6df-042ff69d53cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:59.606601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5307c0-3cf1-4f63-8103-0371eb67facd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:59.606988 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1162bb3-881f-4ed1-b6df-042ff69d53cf None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.607265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1162bb3-881f-4ed1-b6df-042ff69d53cf None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.607531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1162bb3-881f-4ed1-b6df-042ff69d53cf None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.608340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1162bb3-881f-4ed1-b6df-042ff69d53cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:59.608755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1162bb3-881f-4ed1-b6df-042ff69d53cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:59.610157 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1162bb3-881f-4ed1-b6df-042ff69d53cf None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:59.619872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 237/488] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:05:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:59.621195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1162bb3-881f-4ed1-b6df-042ff69d53cf None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:59.635128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:59.643192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e5ac0-86f1-4746-bfa3-33fc831170f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:59.645048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e5ac0-86f1-4746-bfa3-33fc831170f9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.645048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e5ac0-86f1-4746-bfa3-33fc831170f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.645048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e5ac0-86f1-4746-bfa3-33fc831170f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.655680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e5ac0-86f1-4746-bfa3-33fc831170f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-452e5ac0-86f1-4746-bfa3-33fc831170f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:59.661066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:59.662311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:59.663120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:59.663713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 252/489] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:05:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:59.665040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e5ac0-86f1-4746-bfa3-33fc831170f9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:59.732490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1162bb3-881f-4ed1-b6df-042ff69d53cf None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:59.735682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:59.770809 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d66f89-f614-47f0-b58f-93efaf37e192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:59.771442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66f89-f614-47f0-b58f-93efaf37e192 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.771717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66f89-f614-47f0-b58f-93efaf37e192 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.771986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66f89-f614-47f0-b58f-93efaf37e192 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.782387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e5ac0-86f1-4746-bfa3-33fc831170f9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:59.784230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d66f89-f614-47f0-b58f-93efaf37e192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-14d66f89-f614-47f0-b58f-93efaf37e192 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:59.789014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:59.789942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:05:59.790745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 238/490] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:05:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:59.792425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d66f89-f614-47f0-b58f-93efaf37e192 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:59.825022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c70f7-42a1-44dc-ab6f-4d7f8cea2ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:59.826023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c70f7-42a1-44dc-ab6f-4d7f8cea2ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.826496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c70f7-42a1-44dc-ab6f-4d7f8cea2ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.826954 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c70f7-42a1-44dc-ab6f-4d7f8cea2ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.838531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c70f7-42a1-44dc-ab6f-4d7f8cea2ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:59.840456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c70f7-42a1-44dc-ab6f-4d7f8cea2ea5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-aa4c70f7-42a1-44dc-ab6f-4d7f8cea2ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:59.857276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:59.858220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:59.859076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:59.859076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:59.859076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:05:59.861189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 253/491] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:59.862348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c70f7-42a1-44dc-ab6f-4d7f8cea2ea5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:59.897622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d66f89-f614-47f0-b58f-93efaf37e192 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:59.908708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:59.934315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2e2b1-79a7-411e-9dd7-b35d866c8ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:59.934989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2e2b1-79a7-411e-9dd7-b35d866c8ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.935259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2e2b1-79a7-411e-9dd7-b35d866c8ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.935532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2e2b1-79a7-411e-9dd7-b35d866c8ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.936184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2e2b1-79a7-411e-9dd7-b35d866c8ff1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:59.936477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2e2b1-79a7-411e-9dd7-b35d866c8ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:59.937866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2e2b1-79a7-411e-9dd7-b35d866c8ff1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:59.946461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 239/492] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:05:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:59.947315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2e2b1-79a7-411e-9dd7-b35d866c8ff1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:59.975363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c70f7-42a1-44dc-ab6f-4d7f8cea2ea5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:59.976268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.012462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838e5ee-975a-46f6-8c76-b3bb7f094d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.013091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838e5ee-975a-46f6-8c76-b3bb7f094d3b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.013337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838e5ee-975a-46f6-8c76-b3bb7f094d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.013647 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838e5ee-975a-46f6-8c76-b3bb7f094d3b None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.014298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838e5ee-975a-46f6-8c76-b3bb7f094d3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:00.014595 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838e5ee-975a-46f6-8c76-b3bb7f094d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.015998 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838e5ee-975a-46f6-8c76-b3bb7f094d3b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.025110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 254/493] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:05:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:00.026666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0308f62-5b1d-49e5-875d-10ca32bc55b2 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.026980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0308f62-5b1d-49e5-875d-10ca32bc55b2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.027527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0308f62-5b1d-49e5-875d-10ca32bc55b2 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.028613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 255/494] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:00.029136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0308f62-5b1d-49e5-875d-10ca32bc55b2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.063936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2e2b1-79a7-411e-9dd7-b35d866c8ff1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.098998 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4bfa1-7974-4d94-b42d-d03701535a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.099602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4bfa1-7974-4d94-b42d-d03701535a8b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.099872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4bfa1-7974-4d94-b42d-d03701535a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.100136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4bfa1-7974-4d94-b42d-d03701535a8b None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.100762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4bfa1-7974-4d94-b42d-d03701535a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:00.101054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4bfa1-7974-4d94-b42d-d03701535a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.102559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4bfa1-7974-4d94-b42d-d03701535a8b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.118938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 240/495] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:00.118938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4bfa1-7974-4d94-b42d-d03701535a8b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.141471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0308f62-5b1d-49e5-875d-10ca32bc55b2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.143059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.179045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42db556-b41a-4148-8b7a-1a6ab336dae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.179646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42db556-b41a-4148-8b7a-1a6ab336dae4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.179926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42db556-b41a-4148-8b7a-1a6ab336dae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.180239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42db556-b41a-4148-8b7a-1a6ab336dae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.191164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42db556-b41a-4148-8b7a-1a6ab336dae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.192618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42db556-b41a-4148-8b7a-1a6ab336dae4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.203155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c42db556-b41a-4148-8b7a-1a6ab336dae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:00.209146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:00.217084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:00.217971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:00.217971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:00.217971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:00.217971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 256/496] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:00.217971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d37ef9-a230-4459-a7da-b8357a1b67b3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.217971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d37ef9-a230-4459-a7da-b8357a1b67b3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.217971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d37ef9-a230-4459-a7da-b8357a1b67b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.223981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4bfa1-7974-4d94-b42d-d03701535a8b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.235202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-23d37ef9-a230-4459-a7da-b8357a1b67b3 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:00.236392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-23d37ef9-a230-4459-a7da-b8357a1b67b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:00.259288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d5dde-06dd-4ee2-b2ac-369e8419db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.259943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5dde-06dd-4ee2-b2ac-369e8419db6b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.260212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5dde-06dd-4ee2-b2ac-369e8419db6b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.260476 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5dde-06dd-4ee2-b2ac-369e8419db6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.270590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d5dde-06dd-4ee2-b2ac-369e8419db6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.273016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d5dde-06dd-4ee2-b2ac-369e8419db6b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-2d4d5dde-06dd-4ee2-b2ac-369e8419db6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:00.290483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:00.292042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:00.292863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:00.292863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:00.292863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:00.292863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 241/497] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:00.293357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d5dde-06dd-4ee2-b2ac-369e8419db6b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.306964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 257/498] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:00.308180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d37ef9-a230-4459-a7da-b8357a1b67b3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.425089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.426639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d5dde-06dd-4ee2-b2ac-369e8419db6b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.449522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d37ef9-a230-4459-a7da-b8357a1b67b3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.465062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba02b88-d211-4dc3-ba7f-29ec9fb0483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.465715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba02b88-d211-4dc3-ba7f-29ec9fb0483c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.465986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba02b88-d211-4dc3-ba7f-29ec9fb0483c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.466248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba02b88-d211-4dc3-ba7f-29ec9fb0483c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.468924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.474110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba02b88-d211-4dc3-ba7f-29ec9fb0483c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.475563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba02b88-d211-4dc3-ba7f-29ec9fb0483c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.486718 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437eb48a-947e-4469-858f-469923b3eedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.487329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eb48a-947e-4469-858f-469923b3eedc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.487608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eb48a-947e-4469-858f-469923b3eedc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.487880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eb48a-947e-4469-858f-469923b3eedc None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.488521 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437eb48a-947e-4469-858f-469923b3eedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:00.488817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437eb48a-947e-4469-858f-469923b3eedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-dba02b88-d211-4dc3-ba7f-29ec9fb0483c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:00.490068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:00.490942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:00.491839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:00.491839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:00.491839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:00.491839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:00.491839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:00.491839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:00.491839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:00.491839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:00.491839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:06:00.491839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:00.492352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437eb48a-947e-4469-858f-469923b3eedc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.494052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 242/499] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:00.495488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba02b88-d211-4dc3-ba7f-29ec9fb0483c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.504612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 258/500] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:00.505968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eebf0-0576-4d15-bc3d-c5cafed3c16c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.506257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eebf0-0576-4d15-bc3d-c5cafed3c16c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.506533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eebf0-0576-4d15-bc3d-c5cafed3c16c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.512236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 259/501] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:00.513081 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953eebf0-0576-4d15-bc3d-c5cafed3c16c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.608308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba02b88-d211-4dc3-ba7f-29ec9fb0483c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.625070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953eebf0-0576-4d15-bc3d-c5cafed3c16c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.643390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e849d4d-c8c8-40b3-96b9-9120833e8913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.643996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e849d4d-c8c8-40b3-96b9-9120833e8913 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.644274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e849d4d-c8c8-40b3-96b9-9120833e8913 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.644553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e849d4d-c8c8-40b3-96b9-9120833e8913 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.645188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e849d4d-c8c8-40b3-96b9-9120833e8913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:00.645525 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e849d4d-c8c8-40b3-96b9-9120833e8913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.646904 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e849d4d-c8c8-40b3-96b9-9120833e8913 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.657548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3366e-14e6-4020-a5f2-9db55320eef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.658151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3366e-14e6-4020-a5f2-9db55320eef2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.658424 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3366e-14e6-4020-a5f2-9db55320eef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.658686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3366e-14e6-4020-a5f2-9db55320eef2 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.658846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 243/502] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:00.659400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3366e-14e6-4020-a5f2-9db55320eef2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:00.659602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e849d4d-c8c8-40b3-96b9-9120833e8913 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.659694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3366e-14e6-4020-a5f2-9db55320eef2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.661079 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3366e-14e6-4020-a5f2-9db55320eef2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.698305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 260/503] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:00.699505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a0d8b-b2f5-4551-951e-cdbd64ff187a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.699848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a0d8b-b2f5-4551-951e-cdbd64ff187a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.700054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a0d8b-b2f5-4551-951e-cdbd64ff187a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.706110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.717669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2d5a0d8b-b2f5-4551-951e-cdbd64ff187a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:00.717866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.718857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2d5a0d8b-b2f5-4551-951e-cdbd64ff187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:00.763288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e849d4d-c8c8-40b3-96b9-9120833e8913 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.785313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 261/504] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:00.786170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a0d8b-b2f5-4551-951e-cdbd64ff187a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.803401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158462b-c397-41da-820a-dcdf7cc66576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.804195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158462b-c397-41da-820a-dcdf7cc66576 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.804480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158462b-c397-41da-820a-dcdf7cc66576 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.804753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158462b-c397-41da-820a-dcdf7cc66576 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.812631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158462b-c397-41da-820a-dcdf7cc66576 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.814101 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158462b-c397-41da-820a-dcdf7cc66576 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-d158462b-c397-41da-820a-dcdf7cc66576 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:00.826716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:00.827609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:00.828490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:00.828490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:00.828490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:00.828490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:00.828490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:00.828490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:00.828490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:00.828490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:00.828490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:00.828490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:00.828490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 244/505] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:00.829055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158462b-c397-41da-820a-dcdf7cc66576 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.907361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a0d8b-b2f5-4551-951e-cdbd64ff187a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.939689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.945705 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3603e-e345-4df4-8073-bd097d3f442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.946492 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3603e-e345-4df4-8073-bd097d3f442a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.946661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158462b-c397-41da-820a-dcdf7cc66576 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.946952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3603e-e345-4df4-8073-bd097d3f442a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.947419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3603e-e345-4df4-8073-bd097d3f442a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.957841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3603e-e345-4df4-8073-bd097d3f442a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-fae3603e-e345-4df4-8073-bd097d3f442a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:00.962347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:00.963841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:00.965041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 262/506] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:00.965773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3603e-e345-4df4-8073-bd097d3f442a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.966456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.985914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be352b-397d-4fbc-8ae3-7dd45f76f7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.986926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be352b-397d-4fbc-8ae3-7dd45f76f7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.987350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be352b-397d-4fbc-8ae3-7dd45f76f7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.987616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be352b-397d-4fbc-8ae3-7dd45f76f7a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.997213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be352b-397d-4fbc-8ae3-7dd45f76f7a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.998817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be352b-397d-4fbc-8ae3-7dd45f76f7a2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-61be352b-397d-4fbc-8ae3-7dd45f76f7a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:01.010620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:01.011532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:01.012443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:01.012443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:01.012443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:01.012443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:01.012443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:01.012443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:01.012443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:01.012443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:01.012443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:06:01.012443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:01.016382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 245/507] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:01.017155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be352b-397d-4fbc-8ae3-7dd45f76f7a2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.078566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3603e-e345-4df4-8073-bd097d3f442a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.113322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe0c18-2dec-4c46-8f8f-b0aa58241074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.113941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe0c18-2dec-4c46-8f8f-b0aa58241074 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.114215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe0c18-2dec-4c46-8f8f-b0aa58241074 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.114485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe0c18-2dec-4c46-8f8f-b0aa58241074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.118944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be352b-397d-4fbc-8ae3-7dd45f76f7a2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.154217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc143e0e-bb8c-4e02-8754-376cc5c6aae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.154820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc143e0e-bb8c-4e02-8754-376cc5c6aae5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.155100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc143e0e-bb8c-4e02-8754-376cc5c6aae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.155372 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc143e0e-bb8c-4e02-8754-376cc5c6aae5 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.156092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc143e0e-bb8c-4e02-8754-376cc5c6aae5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:01.156396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc143e0e-bb8c-4e02-8754-376cc5c6aae5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.157857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc143e0e-bb8c-4e02-8754-376cc5c6aae5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.170730 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.179670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe0c18-2dec-4c46-8f8f-b0aa58241074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.181332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe0c18-2dec-4c46-8f8f-b0aa58241074 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.193633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 246/508] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:01.194462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc143e0e-bb8c-4e02-8754-376cc5c6aae5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.228958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.279686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 263/509] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:06:01.280518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe0c18-2dec-4c46-8f8f-b0aa58241074 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.293656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc143e0e-bb8c-4e02-8754-376cc5c6aae5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.326938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd6f9e-093f-4680-a083-8a971a2a2d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.327538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd6f9e-093f-4680-a083-8a971a2a2d52 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.327810 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd6f9e-093f-4680-a083-8a971a2a2d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.328078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd6f9e-093f-4680-a083-8a971a2a2d52 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.328734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd6f9e-093f-4680-a083-8a971a2a2d52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:01.329027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd6f9e-093f-4680-a083-8a971a2a2d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.330442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd6f9e-093f-4680-a083-8a971a2a2d52 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.339193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 247/510] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:01.339789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd6f9e-093f-4680-a083-8a971a2a2d52 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.371305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.379603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe0c18-2dec-4c46-8f8f-b0aa58241074 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.413313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fddee-cc74-487d-b7b7-5980cda732d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.413939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fddee-cc74-487d-b7b7-5980cda732d0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.414212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fddee-cc74-487d-b7b7-5980cda732d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.414476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fddee-cc74-487d-b7b7-5980cda732d0 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.415185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fddee-cc74-487d-b7b7-5980cda732d0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:01.415484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fddee-cc74-487d-b7b7-5980cda732d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.416944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fddee-cc74-487d-b7b7-5980cda732d0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.433393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 264/511] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:01.434115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.434254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fddee-cc74-487d-b7b7-5980cda732d0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.441182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd6f9e-093f-4680-a083-8a971a2a2d52 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.476471 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e95690-3523-4a0a-b0d3-bc1902a9e2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.477105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95690-3523-4a0a-b0d3-bc1902a9e2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.477399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95690-3523-4a0a-b0d3-bc1902a9e2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.477675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95690-3523-4a0a-b0d3-bc1902a9e2b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.487667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e95690-3523-4a0a-b0d3-bc1902a9e2b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.489071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e95690-3523-4a0a-b0d3-bc1902a9e2b9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-47e95690-3523-4a0a-b0d3-bc1902a9e2b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:01.503788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:01.504820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:01.505689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:01.505689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:01.505689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:01.505689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 248/512] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:01.505689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e95690-3523-4a0a-b0d3-bc1902a9e2b9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.531581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fddee-cc74-487d-b7b7-5980cda732d0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.564787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdecd8-fedc-45f4-9fec-79e71c1e8a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.565405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdecd8-fedc-45f4-9fec-79e71c1e8a75 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.565681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdecd8-fedc-45f4-9fec-79e71c1e8a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.565947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdecd8-fedc-45f4-9fec-79e71c1e8a75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.584843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.607573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e95690-3523-4a0a-b0d3-bc1902a9e2b9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.632707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdecd8-fedc-45f4-9fec-79e71c1e8a75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.634204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdecd8-fedc-45f4-9fec-79e71c1e8a75 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.641205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86b831-11d6-4db5-ae14-6ddd28c9881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.641854 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86b831-11d6-4db5-ae14-6ddd28c9881d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.642126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86b831-11d6-4db5-ae14-6ddd28c9881d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.642388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86b831-11d6-4db5-ae14-6ddd28c9881d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.652717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86b831-11d6-4db5-ae14-6ddd28c9881d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.654178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86b831-11d6-4db5-ae14-6ddd28c9881d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.662270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-8c86b831-11d6-4db5-ae14-6ddd28c9881d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:01.668364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:01.672109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:01.672969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:01.672969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:01.672969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:01.672969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 249/513] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:01.672969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86b831-11d6-4db5-ae14-6ddd28c9881d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.734215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 265/514] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:06:01.735124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdecd8-fedc-45f4-9fec-79e71c1e8a75 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.772730 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86b831-11d6-4db5-ae14-6ddd28c9881d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.784472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.805587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4bc9a-1c64-4d7f-a787-85bf88f1d5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.806241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4bc9a-1c64-4d7f-a787-85bf88f1d5bb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.807063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4bc9a-1c64-4d7f-a787-85bf88f1d5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.807429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4bc9a-1c64-4d7f-a787-85bf88f1d5bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.817925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4bc9a-1c64-4d7f-a787-85bf88f1d5bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.819520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4bc9a-1c64-4d7f-a787-85bf88f1d5bb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.833230 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdecd8-fedc-45f4-9fec-79e71c1e8a75 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-7cb4bc9a-1c64-4d7f-a787-85bf88f1d5bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:01.833793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:01.834795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:01.835623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:01.835623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:01.835623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:01.835623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 250/515] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:01.835623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4bc9a-1c64-4d7f-a787-85bf88f1d5bb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.870713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10bfc9-a137-4b11-a7ac-b75b28ad9842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.871313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bfc9-a137-4b11-a7ac-b75b28ad9842 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.871588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bfc9-a137-4b11-a7ac-b75b28ad9842 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.871856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bfc9-a137-4b11-a7ac-b75b28ad9842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.891460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.937821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4bc9a-1c64-4d7f-a787-85bf88f1d5bb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.939934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10bfc9-a137-4b11-a7ac-b75b28ad9842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.941591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10bfc9-a137-4b11-a7ac-b75b28ad9842 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.973267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192d21e-f1c8-4662-98c4-98c189a92e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.973890 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192d21e-f1c8-4662-98c4-98c189a92e36 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.974164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192d21e-f1c8-4662-98c4-98c189a92e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.974431 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192d21e-f1c8-4662-98c4-98c189a92e36 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.975059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192d21e-f1c8-4662-98c4-98c189a92e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:01.975350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192d21e-f1c8-4662-98c4-98c189a92e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.976770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192d21e-f1c8-4662-98c4-98c189a92e36 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.988369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 251/516] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:01.989154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192d21e-f1c8-4662-98c4-98c189a92e36 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.989939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:02.043841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 266/517] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:06:02.044629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10bfc9-a137-4b11-a7ac-b75b28ad9842 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.090377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192d21e-f1c8-4662-98c4-98c189a92e36 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.103461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:02.123185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bce15-e679-4d14-b0f0-d7bae1e0b660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.123784 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bce15-e679-4d14-b0f0-d7bae1e0b660 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.124059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bce15-e679-4d14-b0f0-d7bae1e0b660 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.124326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bce15-e679-4d14-b0f0-d7bae1e0b660 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.124966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bce15-e679-4d14-b0f0-d7bae1e0b660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:02.125624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bce15-e679-4d14-b0f0-d7bae1e0b660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.127624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bce15-e679-4d14-b0f0-d7bae1e0b660 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.139504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 252/518] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:02.140342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bce15-e679-4d14-b0f0-d7bae1e0b660 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.147751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10bfc9-a137-4b11-a7ac-b75b28ad9842 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.181149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a26b5-d31f-47fe-abdf-f6de5f7e8d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.181945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a26b5-d31f-47fe-abdf-f6de5f7e8d77 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.182231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a26b5-d31f-47fe-abdf-f6de5f7e8d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.182507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a26b5-d31f-47fe-abdf-f6de5f7e8d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.192152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a26b5-d31f-47fe-abdf-f6de5f7e8d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.193625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a26b5-d31f-47fe-abdf-f6de5f7e8d77 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-db2a26b5-d31f-47fe-abdf-f6de5f7e8d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:02.208306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:02.209411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:02.210512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:02.210512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:02.210512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:02.210512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 267/519] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:02.210512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a26b5-d31f-47fe-abdf-f6de5f7e8d77 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.212640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:02.241486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bce15-e679-4d14-b0f0-d7bae1e0b660 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.276319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402ae98-400f-41c0-aa27-0892afdd4b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.276922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402ae98-400f-41c0-aa27-0892afdd4b85 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.277205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402ae98-400f-41c0-aa27-0892afdd4b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.277506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402ae98-400f-41c0-aa27-0892afdd4b85 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.278142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402ae98-400f-41c0-aa27-0892afdd4b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:02.278441 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402ae98-400f-41c0-aa27-0892afdd4b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.279815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402ae98-400f-41c0-aa27-0892afdd4b85 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.291944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 253/520] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:02.292740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402ae98-400f-41c0-aa27-0892afdd4b85 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.309298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a26b5-d31f-47fe-abdf-f6de5f7e8d77 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.327202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:02.343057 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a166-2d70-40dc-b9ca-e624aa03a06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.343651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a166-2d70-40dc-b9ca-e624aa03a06c None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.343929 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a166-2d70-40dc-b9ca-e624aa03a06c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.344197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a166-2d70-40dc-b9ca-e624aa03a06c None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.344824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148a166-2d70-40dc-b9ca-e624aa03a06c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.346285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148a166-2d70-40dc-b9ca-e624aa03a06c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.396075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402ae98-400f-41c0-aa27-0892afdd4b85 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.399777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 268/521] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:06:02 2022] POST /identity/v3/users => generated 247 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:02.399777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a166-2d70-40dc-b9ca-e624aa03a06c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.435615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a497a-c614-4325-bab9-b66af1bb28f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.436295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a497a-c614-4325-bab9-b66af1bb28f5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.436567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a497a-c614-4325-bab9-b66af1bb28f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.436830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a497a-c614-4325-bab9-b66af1bb28f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.448980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a497a-c614-4325-bab9-b66af1bb28f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.450497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a497a-c614-4325-bab9-b66af1bb28f5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-039a497a-c614-4325-bab9-b66af1bb28f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:02.466111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:02.467098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:02.467946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:02.467946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:02.467946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:02.468108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:02.468178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 254/522] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:02.468670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a497a-c614-4325-bab9-b66af1bb28f5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.516155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a166-2d70-40dc-b9ca-e624aa03a06c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.559769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6f675-2708-4485-bfa3-1d55c3f073a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.560681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6f675-2708-4485-bfa3-1d55c3f073a8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.561135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6f675-2708-4485-bfa3-1d55c3f073a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.562062 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6f675-2708-4485-bfa3-1d55c3f073a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.569115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6f675-2708-4485-bfa3-1d55c3f073a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.570879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6f675-2708-4485-bfa3-1d55c3f073a8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.571597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e0c6f675-2708-4485-bfa3-1d55c3f073a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:02.584422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:02.591634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:02.592480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:02.592480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:02.592480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:02.592480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:02.592480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:02.592480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:02.592480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:02.592480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:02.592480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 269/523] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:02.592480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6f675-2708-4485-bfa3-1d55c3f073a8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.593702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a497a-c614-4325-bab9-b66af1bb28f5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.632130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc192bf-b4ee-4fcb-b988-31976c47ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.632743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc192bf-b4ee-4fcb-b988-31976c47ba15 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.633020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc192bf-b4ee-4fcb-b988-31976c47ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.633292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc192bf-b4ee-4fcb-b988-31976c47ba15 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.633979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc192bf-b4ee-4fcb-b988-31976c47ba15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:02.634280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc192bf-b4ee-4fcb-b988-31976c47ba15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.636067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc192bf-b4ee-4fcb-b988-31976c47ba15 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.647989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 255/524] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:02.648859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc192bf-b4ee-4fcb-b988-31976c47ba15 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.705527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6f675-2708-4485-bfa3-1d55c3f073a8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.723533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:02.744811 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f236c-c5df-45b7-a02d-3b9ac878d016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.745480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f236c-c5df-45b7-a02d-3b9ac878d016 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.745757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f236c-c5df-45b7-a02d-3b9ac878d016 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.746124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f236c-c5df-45b7-a02d-3b9ac878d016 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.754240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f236c-c5df-45b7-a02d-3b9ac878d016 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.756162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f236c-c5df-45b7-a02d-3b9ac878d016 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.756273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc192bf-b4ee-4fcb-b988-31976c47ba15 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b54f236c-c5df-45b7-a02d-3b9ac878d016 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:02.769252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:02.770361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 270/525] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:02.771240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f236c-c5df-45b7-a02d-3b9ac878d016 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.797643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d418e-d2d9-4c9d-8433-adb54f27c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.798265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d418e-d2d9-4c9d-8433-adb54f27c628 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.798538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d418e-d2d9-4c9d-8433-adb54f27c628 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.798810 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d418e-d2d9-4c9d-8433-adb54f27c628 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.799447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d418e-d2d9-4c9d-8433-adb54f27c628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:02.799745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d418e-d2d9-4c9d-8433-adb54f27c628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.801106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d418e-d2d9-4c9d-8433-adb54f27c628 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.815122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 256/526] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:02.815762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d418e-d2d9-4c9d-8433-adb54f27c628 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.820667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:02.887039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f236c-c5df-45b7-a02d-3b9ac878d016 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.924790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a182d2-bb3e-4683-98d5-59ca52344198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.925441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a182d2-bb3e-4683-98d5-59ca52344198 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.925725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a182d2-bb3e-4683-98d5-59ca52344198 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.926005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a182d2-bb3e-4683-98d5-59ca52344198 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.926733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a182d2-bb3e-4683-98d5-59ca52344198 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:02.927037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a182d2-bb3e-4683-98d5-59ca52344198 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.928492 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a182d2-bb3e-4683-98d5-59ca52344198 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.935661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d418e-d2d9-4c9d-8433-adb54f27c628 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.949015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 271/527] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:02.950267 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a182d2-bb3e-4683-98d5-59ca52344198 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.974852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef16556-0b79-4952-b897-e3e63f642bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.975791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef16556-0b79-4952-b897-e3e63f642bec None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.976008 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef16556-0b79-4952-b897-e3e63f642bec None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.976340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef16556-0b79-4952-b897-e3e63f642bec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.984163 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef16556-0b79-4952-b897-e3e63f642bec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.985584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef16556-0b79-4952-b897-e3e63f642bec None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-2ef16556-0b79-4952-b897-e3e63f642bec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:02.998256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:02.999218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:03.000105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:03.000105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:03.000105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:03.000105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:03.000105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:03.000105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:03.000105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:03.000105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:03.000105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 257/528] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:03.000564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef16556-0b79-4952-b897-e3e63f642bec None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.001946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:03.064804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a182d2-bb3e-4683-98d5-59ca52344198 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.069326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:03.100624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4ac5c-9ed0-4d35-8ee2-800ec9fd3a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.101539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4ac5c-9ed0-4d35-8ee2-800ec9fd3a14 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.101963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4ac5c-9ed0-4d35-8ee2-800ec9fd3a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.102236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4ac5c-9ed0-4d35-8ee2-800ec9fd3a14 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.102959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4ac5c-9ed0-4d35-8ee2-800ec9fd3a14 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:03.103291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4ac5c-9ed0-4d35-8ee2-800ec9fd3a14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.105439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4ac5c-9ed0-4d35-8ee2-800ec9fd3a14 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.112605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef16556-0b79-4952-b897-e3e63f642bec None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.127742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 272/529] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 17 16:06:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:03.127742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4ac5c-9ed0-4d35-8ee2-800ec9fd3a14 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.147349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c02e7-f7af-4c8f-ba33-4b539ac5fe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.147799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c02e7-f7af-4c8f-ba33-4b539ac5fe85 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.148076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c02e7-f7af-4c8f-ba33-4b539ac5fe85 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.148342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c02e7-f7af-4c8f-ba33-4b539ac5fe85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.155735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c02e7-f7af-4c8f-ba33-4b539ac5fe85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.157237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c02e7-f7af-4c8f-ba33-4b539ac5fe85 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-7d9c02e7-f7af-4c8f-ba33-4b539ac5fe85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:03.168704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:03.169588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:03.170765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:03.170765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:03.170765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:03.170765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:03.170765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:03.170765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:03.170765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:03.170765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:03.170765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 258/530] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:03.171352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c02e7-f7af-4c8f-ba33-4b539ac5fe85 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.233818 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:03.239805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4ac5c-9ed0-4d35-8ee2-800ec9fd3a14 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.274309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c02e7-f7af-4c8f-ba33-4b539ac5fe85 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.276531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f1974-a5ba-4277-a64c-e418a0433933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.277140 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f1974-a5ba-4277-a64c-e418a0433933 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.277452 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f1974-a5ba-4277-a64c-e418a0433933 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.277734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f1974-a5ba-4277-a64c-e418a0433933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.278457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f1974-a5ba-4277-a64c-e418a0433933 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=e9b8a5b38ac046ed8e8b98f0ecefb07f) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:03.278761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f1974-a5ba-4277-a64c-e418a0433933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.280216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f1974-a5ba-4277-a64c-e418a0433933 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.285633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 273/531] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:03 2022] GET /identity/v3/role_assignments?user.id=e9b8a5b38ac046ed8e8b98f0ecefb07f&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:03.286439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f1974-a5ba-4277-a64c-e418a0433933 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.322639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:03.335355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a62e3-bcfa-4064-8ece-89d317223a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.336977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a62e3-bcfa-4064-8ece-89d317223a95 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.336977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a62e3-bcfa-4064-8ece-89d317223a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.336977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a62e3-bcfa-4064-8ece-89d317223a95 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.337467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a62e3-bcfa-4064-8ece-89d317223a95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:03.338530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a62e3-bcfa-4064-8ece-89d317223a95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.340174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a62e3-bcfa-4064-8ece-89d317223a95 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.363021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 259/532] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:03.363963 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a62e3-bcfa-4064-8ece-89d317223a95 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.424337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f1974-a5ba-4277-a64c-e418a0433933 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.463921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92602e-2478-4656-aadb-61cb7db59d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.464949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92602e-2478-4656-aadb-61cb7db59d80 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.465468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92602e-2478-4656-aadb-61cb7db59d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.465935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92602e-2478-4656-aadb-61cb7db59d80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.479845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a62e3-bcfa-4064-8ece-89d317223a95 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.496250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:03.516873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf18b3e-d6f6-432a-92c4-b85a1554c111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.517518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf18b3e-d6f6-432a-92c4-b85a1554c111 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.517794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf18b3e-d6f6-432a-92c4-b85a1554c111 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.518062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf18b3e-d6f6-432a-92c4-b85a1554c111 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.518774 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf18b3e-d6f6-432a-92c4-b85a1554c111 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:03.519135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf18b3e-d6f6-432a-92c4-b85a1554c111 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.520589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf18b3e-d6f6-432a-92c4-b85a1554c111 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.537421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 260/533] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:03.537421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf18b3e-d6f6-432a-92c4-b85a1554c111 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.553975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92602e-2478-4656-aadb-61cb7db59d80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.556421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92602e-2478-4656-aadb-61cb7db59d80 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.589592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:03.658072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf18b3e-d6f6-432a-92c4-b85a1554c111 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.679931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 274/534] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:06:03.680997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92602e-2478-4656-aadb-61cb7db59d80 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.707386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e381-bf7e-4735-88b6-8edadf88802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.708260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e381-bf7e-4735-88b6-8edadf88802a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.708679 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e381-bf7e-4735-88b6-8edadf88802a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.709645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e381-bf7e-4735-88b6-8edadf88802a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.710542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86e381-bf7e-4735-88b6-8edadf88802a None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=f99edbaee8504487863c6fa4b551c224) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:03.711255 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86e381-bf7e-4735-88b6-8edadf88802a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.714295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86e381-bf7e-4735-88b6-8edadf88802a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.729617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 261/535] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:03 2022] GET /identity/v3/role_assignments?user.id=f99edbaee8504487863c6fa4b551c224&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:03.729617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e381-bf7e-4735-88b6-8edadf88802a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.772957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:03.855189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92602e-2478-4656-aadb-61cb7db59d80 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.869399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e381-bf7e-4735-88b6-8edadf88802a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.877784 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:03.910207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fb103-fc35-4b1b-a563-b4df1806854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.911342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fb103-fc35-4b1b-a563-b4df1806854f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.911840 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fb103-fc35-4b1b-a563-b4df1806854f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.912309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fb103-fc35-4b1b-a563-b4df1806854f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.913313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73fb103-fc35-4b1b-a563-b4df1806854f None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=4227da1895a94c9c845c4f7adf838144) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:03.913857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73fb103-fc35-4b1b-a563-b4df1806854f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.915519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73fb103-fc35-4b1b-a563-b4df1806854f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.923296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 275/536] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:03 2022] GET /identity/v3/role_assignments?user.id=4227da1895a94c9c845c4f7adf838144&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:03.944809 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63090e2b-c03e-4b37-9db6-1179c1f61e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.946123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63090e2b-c03e-4b37-9db6-1179c1f61e50 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.946600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63090e2b-c03e-4b37-9db6-1179c1f61e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.947350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63090e2b-c03e-4b37-9db6-1179c1f61e50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.961171 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63090e2b-c03e-4b37-9db6-1179c1f61e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.963732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63090e2b-c03e-4b37-9db6-1179c1f61e50 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-63090e2b-c03e-4b37-9db6-1179c1f61e50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:03.985692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:03.986759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:03.987601 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:03.987601 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:03.987601 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:03.995555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 262/537] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:04.001417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fb103-fc35-4b1b-a563-b4df1806854f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:04.132042 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fb103-fc35-4b1b-a563-b4df1806854f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:04.158186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:04.172615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a1ae0-048a-44ea-8d26-dbfe041675ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:04.181087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1ae0-048a-44ea-8d26-dbfe041675ef None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:04.181087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1ae0-048a-44ea-8d26-dbfe041675ef None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:04.181087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1ae0-048a-44ea-8d26-dbfe041675ef None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:04.181087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a1ae0-048a-44ea-8d26-dbfe041675ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:04.181087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a1ae0-048a-44ea-8d26-dbfe041675ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:04.181087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a1ae0-048a-44ea-8d26-dbfe041675ef None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:04.189166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 276/538] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:04.194544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63090e2b-c03e-4b37-9db6-1179c1f61e50 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:04.333357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63090e2b-c03e-4b37-9db6-1179c1f61e50 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:04.367777 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723e356-1fb3-4cb8-9ebd-4c01dff8793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:04.368400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723e356-1fb3-4cb8-9ebd-4c01dff8793e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:04.368679 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723e356-1fb3-4cb8-9ebd-4c01dff8793e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:04.369093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723e356-1fb3-4cb8-9ebd-4c01dff8793e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:04.382220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723e356-1fb3-4cb8-9ebd-4c01dff8793e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:04.383606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723e356-1fb3-4cb8-9ebd-4c01dff8793e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-8723e356-1fb3-4cb8-9ebd-4c01dff8793e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:04.401670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:04.402568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:04.403413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:04.403413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:04.403413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:04.403413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:04.403413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:04.403413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:04.403413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:04.403413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:04.407460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 263/539] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:04.414493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a1ae0-048a-44ea-8d26-dbfe041675ef None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:04.476222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92311ab-3e64-45db-bf91-2de0c95b60ce None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:04.476565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92311ab-3e64-45db-bf91-2de0c95b60ce None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:04.476774 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92311ab-3e64-45db-bf91-2de0c95b60ce None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:04.478469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 264/540] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:06:04.491616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711b21e-c26d-4dac-80ab-6c937d34c553 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:04.491894 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711b21e-c26d-4dac-80ab-6c937d34c553 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:04.492167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711b21e-c26d-4dac-80ab-6c937d34c553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:04.534343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c711b21e-c26d-4dac-80ab-6c937d34c553 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:04.535926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c711b21e-c26d-4dac-80ab-6c937d34c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:04.567085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:04.582876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a1ae0-048a-44ea-8d26-dbfe041675ef None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:04.651092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0fe74-3b31-407c-99cc-ef63cb6151c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:04.652081 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0fe74-3b31-407c-99cc-ef63cb6151c0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:04.652584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0fe74-3b31-407c-99cc-ef63cb6151c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:04.653209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0fe74-3b31-407c-99cc-ef63cb6151c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:04.655116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0fe74-3b31-407c-99cc-ef63cb6151c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:04.655803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0fe74-3b31-407c-99cc-ef63cb6151c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:04.658486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0fe74-3b31-407c-99cc-ef63cb6151c0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:04.680114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 277/541] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:04.683079 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 265/542] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:06:04.690342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0fe74-3b31-407c-99cc-ef63cb6151c0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:04.738753 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:04.796596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0fe74-3b31-407c-99cc-ef63cb6151c0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:04.833355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c22a6-3118-489e-9cf6-890ba26948e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:04.834324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c22a6-3118-489e-9cf6-890ba26948e7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:04.834875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c22a6-3118-489e-9cf6-890ba26948e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:04.835358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c22a6-3118-489e-9cf6-890ba26948e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:04.836280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c22a6-3118-489e-9cf6-890ba26948e7 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=4ad54a22e6e747d9887c82bb62a923da) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:04.836806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c22a6-3118-489e-9cf6-890ba26948e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:04.838509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c22a6-3118-489e-9cf6-890ba26948e7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:04.844432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 278/543] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:04 2022] GET /identity/v3/role_assignments?user.id=4ad54a22e6e747d9887c82bb62a923da&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:05.037847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711b21e-c26d-4dac-80ab-6c937d34c553 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:05.155452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711b21e-c26d-4dac-80ab-6c937d34c553 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:05.196529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320a803-3aca-4fe1-8f03-b32fb6801b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:05.197915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a803-3aca-4fe1-8f03-b32fb6801b09 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.198194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a803-3aca-4fe1-8f03-b32fb6801b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.198464 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a803-3aca-4fe1-8f03-b32fb6801b09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.216012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320a803-3aca-4fe1-8f03-b32fb6801b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-d320a803-3aca-4fe1-8f03-b32fb6801b09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:05.220712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:05.221605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:05.222433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 266/544] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:05.230317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c22a6-3118-489e-9cf6-890ba26948e7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:05.355176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c22a6-3118-489e-9cf6-890ba26948e7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:05.365009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:05.392734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ffc85-18ad-4c6e-a79c-259b091b0367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:05.393811 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ffc85-18ad-4c6e-a79c-259b091b0367 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.394314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ffc85-18ad-4c6e-a79c-259b091b0367 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.394857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ffc85-18ad-4c6e-a79c-259b091b0367 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.395743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ffc85-18ad-4c6e-a79c-259b091b0367 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:05.396258 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ffc85-18ad-4c6e-a79c-259b091b0367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:05.397876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ffc85-18ad-4c6e-a79c-259b091b0367 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:05.407812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 279/545] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:05.413651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320a803-3aca-4fe1-8f03-b32fb6801b09 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:05.441295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:05.526789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6c12f-55fb-4f0d-aebf-a11b7860a66c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.527446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6c12f-55fb-4f0d-aebf-a11b7860a66c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.527925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6c12f-55fb-4f0d-aebf-a11b7860a66c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.530058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 280/546] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:05.534863 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63599f-68d6-4947-92a1-b8333095363d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.535384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63599f-68d6-4947-92a1-b8333095363d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.536014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63599f-68d6-4947-92a1-b8333095363d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.550619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320a803-3aca-4fe1-8f03-b32fb6801b09 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:05.564059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3e63599f-68d6-4947-92a1-b8333095363d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:05.565609 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3e63599f-68d6-4947-92a1-b8333095363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:05.630178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbb988-ab64-45e7-866b-cef77e4e02b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:05.630752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbb988-ab64-45e7-866b-cef77e4e02b4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.631032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbb988-ab64-45e7-866b-cef77e4e02b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.631307 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbb988-ab64-45e7-866b-cef77e4e02b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.641787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 281/547] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:06:05.649238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbb988-ab64-45e7-866b-cef77e4e02b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:05.651907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbb988-ab64-45e7-866b-cef77e4e02b4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-76fbb988-ab64-45e7-866b-cef77e4e02b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:05.670225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:05.671152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:05.672091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:05.672091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:05.672091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:05.674278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 267/548] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:05.680337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63599f-68d6-4947-92a1-b8333095363d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:05.789055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:05.793232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63599f-68d6-4947-92a1-b8333095363d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:05.830879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624202e-cee7-436e-b9c8-73529a898c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:05.831848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624202e-cee7-436e-b9c8-73529a898c51 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.832354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624202e-cee7-436e-b9c8-73529a898c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.832845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624202e-cee7-436e-b9c8-73529a898c51 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.833739 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624202e-cee7-436e-b9c8-73529a898c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:05.834242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624202e-cee7-436e-b9c8-73529a898c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:05.835923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624202e-cee7-436e-b9c8-73529a898c51 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:05.849485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 282/549] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:05.858120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbb988-ab64-45e7-866b-cef77e4e02b4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:05.940600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.041474 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbb988-ab64-45e7-866b-cef77e4e02b4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.053765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624202e-cee7-436e-b9c8-73529a898c51 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.116732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38074-55ed-4d42-826e-edb700c300af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.117387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38074-55ed-4d42-826e-edb700c300af None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.117674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38074-55ed-4d42-826e-edb700c300af None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.117942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38074-55ed-4d42-826e-edb700c300af None admin] PATH_INFO: `/v3/users/swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.138435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe38074-55ed-4d42-826e-edb700c300af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.139883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe38074-55ed-4d42-826e-edb700c300af None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-dbe38074-55ed-4d42-826e-edb700c300af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:06.159488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:06.160571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:06.162021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:06.162021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:06.162021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:06.162021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:06.162021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:06.162021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:06.162021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:06.162021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:06.162021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:06.162021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:06.162021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 268/550] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:06.163342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac98d-25a2-437e-929c-076f1a8a9998 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.163342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac98d-25a2-437e-929c-076f1a8a9998 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.163342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac98d-25a2-437e-929c-076f1a8a9998 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.169396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 269/551] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:06.169396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aac98d-25a2-437e-929c-076f1a8a9998 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.213663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624202e-cee7-436e-b9c8-73529a898c51 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.249658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39706-2d64-4b9a-b680-99a2b69f25f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.250545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39706-2d64-4b9a-b680-99a2b69f25f9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.250701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39706-2d64-4b9a-b680-99a2b69f25f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.251154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39706-2d64-4b9a-b680-99a2b69f25f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.261716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b39706-2d64-4b9a-b680-99a2b69f25f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-31b39706-2d64-4b9a-b680-99a2b69f25f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:06.266762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:06.267827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:06.268648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:06.272605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 283/552] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:06.273901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc894e-ae73-40c7-a41e-7db4e52045c0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.274190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc894e-ae73-40c7-a41e-7db4e52045c0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.274460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc894e-ae73-40c7-a41e-7db4e52045c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.292685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-33fc894e-ae73-40c7-a41e-7db4e52045c0 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:06.293913 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-33fc894e-ae73-40c7-a41e-7db4e52045c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:06.298581 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aac98d-25a2-437e-929c-076f1a8a9998 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.312026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.325247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.340926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760dfe8f-5548-4ae9-8b24-ddd2c88e4145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.340926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dfe8f-5548-4ae9-8b24-ddd2c88e4145 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.340926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dfe8f-5548-4ae9-8b24-ddd2c88e4145 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.340926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dfe8f-5548-4ae9-8b24-ddd2c88e4145 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.341632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760dfe8f-5548-4ae9-8b24-ddd2c88e4145 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:06.341632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760dfe8f-5548-4ae9-8b24-ddd2c88e4145 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.341632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760dfe8f-5548-4ae9-8b24-ddd2c88e4145 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.360718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 270/553] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:06.362349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b30d25-8600-4df6-bc2f-a9ce5020257c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.362638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b30d25-8600-4df6-bc2f-a9ce5020257c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.362906 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b30d25-8600-4df6-bc2f-a9ce5020257c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.367958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 271/554] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:06.367958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b30d25-8600-4df6-bc2f-a9ce5020257c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.377573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 284/555] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:06.378617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc894e-ae73-40c7-a41e-7db4e52045c0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.485829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b30d25-8600-4df6-bc2f-a9ce5020257c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.521840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6e141-93a8-41c0-8776-da71f4fe50b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.522440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6e141-93a8-41c0-8776-da71f4fe50b8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.522711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6e141-93a8-41c0-8776-da71f4fe50b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.523023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6e141-93a8-41c0-8776-da71f4fe50b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.523611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6e141-93a8-41c0-8776-da71f4fe50b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:06.523902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6e141-93a8-41c0-8776-da71f4fe50b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.526001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6e141-93a8-41c0-8776-da71f4fe50b8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.530036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc894e-ae73-40c7-a41e-7db4e52045c0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.537763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 272/556] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:06.539129 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ab5a-504c-472d-bc65-3ff29840615c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.539265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ab5a-504c-472d-bc65-3ff29840615c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.539529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ab5a-504c-472d-bc65-3ff29840615c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.558875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d271ab5a-504c-472d-bc65-3ff29840615c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:06.560043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d271ab5a-504c-472d-bc65-3ff29840615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:06.572345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff7d4c-446e-482d-af42-f66bdc686684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.573795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff7d4c-446e-482d-af42-f66bdc686684 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.574383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff7d4c-446e-482d-af42-f66bdc686684 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.574888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff7d4c-446e-482d-af42-f66bdc686684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.600438 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.602009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.638868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 273/557] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:06.639821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271ab5a-504c-472d-bc65-3ff29840615c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.664005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff7d4c-446e-482d-af42-f66bdc686684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.666335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff7d4c-446e-482d-af42-f66bdc686684 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.764497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271ab5a-504c-472d-bc65-3ff29840615c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.770394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 285/558] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:06:06.771627 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff7d4c-446e-482d-af42-f66bdc686684 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.802814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94f80b-f479-4b0f-9529-472c776a5376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.803446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f80b-f479-4b0f-9529-472c776a5376 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.803719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f80b-f479-4b0f-9529-472c776a5376 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.803984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f80b-f479-4b0f-9529-472c776a5376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.815985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94f80b-f479-4b0f-9529-472c776a5376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.817557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94f80b-f479-4b0f-9529-472c776a5376 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.825514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-0a94f80b-f479-4b0f-9529-472c776a5376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:06.835388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:06.836545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:06.837465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:06.837465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:06.837465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:06.843970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 274/559] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:06.845004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94f80b-f479-4b0f-9529-472c776a5376 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.874800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.881090 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff7d4c-446e-482d-af42-f66bdc686684 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.917964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8322d-ba1e-4ff5-846a-40da34623b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.918906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8322d-ba1e-4ff5-846a-40da34623b3f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.919031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8322d-ba1e-4ff5-846a-40da34623b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.919285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8322d-ba1e-4ff5-846a-40da34623b3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.930060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8322d-ba1e-4ff5-846a-40da34623b3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a4d8322d-ba1e-4ff5-846a-40da34623b3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:06.936212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:06.937688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:06.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:06.941569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 286/560] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:06.942746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8322d-ba1e-4ff5-846a-40da34623b3f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.965117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94f80b-f479-4b0f-9529-472c776a5376 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.003484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17e973-46f4-4032-86bf-522d9ef50adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.004229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17e973-46f4-4032-86bf-522d9ef50adc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.004507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17e973-46f4-4032-86bf-522d9ef50adc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.004769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17e973-46f4-4032-86bf-522d9ef50adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.016323 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17e973-46f4-4032-86bf-522d9ef50adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.017846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17e973-46f4-4032-86bf-522d9ef50adc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-6c17e973-46f4-4032-86bf-522d9ef50adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:07.032875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:07.033870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:07.035561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:07.035561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:07.035561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:07.035561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 275/561] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:07.035561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17e973-46f4-4032-86bf-522d9ef50adc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:07.052054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8322d-ba1e-4ff5-846a-40da34623b3f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.063573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:07.088799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc822cc-beaf-4254-82cb-9892ee597207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.089430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc822cc-beaf-4254-82cb-9892ee597207 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.089712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc822cc-beaf-4254-82cb-9892ee597207 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.089984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc822cc-beaf-4254-82cb-9892ee597207 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.090637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc822cc-beaf-4254-82cb-9892ee597207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:07.090922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc822cc-beaf-4254-82cb-9892ee597207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.092640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc822cc-beaf-4254-82cb-9892ee597207 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:07.110072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 287/562] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:07.110072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc822cc-beaf-4254-82cb-9892ee597207 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:07.118521 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:07.141561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17e973-46f4-4032-86bf-522d9ef50adc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.176560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122933df-6147-4ace-ab56-3fced4094592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.177176 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122933df-6147-4ace-ab56-3fced4094592 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.177487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122933df-6147-4ace-ab56-3fced4094592 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.177752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122933df-6147-4ace-ab56-3fced4094592 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.188606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122933df-6147-4ace-ab56-3fced4094592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-122933df-6147-4ace-ab56-3fced4094592 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:07.193735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:07.194665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 276/563] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:07.195856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122933df-6147-4ace-ab56-3fced4094592 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:07.217750 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc822cc-beaf-4254-82cb-9892ee597207 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.253495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995facd-77ae-4c94-9f38-d303ca665a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.254142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995facd-77ae-4c94-9f38-d303ca665a4f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.254368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995facd-77ae-4c94-9f38-d303ca665a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.254633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995facd-77ae-4c94-9f38-d303ca665a4f None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.255288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995facd-77ae-4c94-9f38-d303ca665a4f None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:07.255583 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995facd-77ae-4c94-9f38-d303ca665a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.256962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995facd-77ae-4c94-9f38-d303ca665a4f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:07.265302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 288/564] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:07.270693 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995facd-77ae-4c94-9f38-d303ca665a4f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:07.299732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122933df-6147-4ace-ab56-3fced4094592 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.304098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:07.334415 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34dbdc-80b9-48cc-8666-f1aba1a0243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.335012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34dbdc-80b9-48cc-8666-f1aba1a0243f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.335280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34dbdc-80b9-48cc-8666-f1aba1a0243f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.335541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34dbdc-80b9-48cc-8666-f1aba1a0243f None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.336166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34dbdc-80b9-48cc-8666-f1aba1a0243f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:07.336461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34dbdc-80b9-48cc-8666-f1aba1a0243f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.337870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34dbdc-80b9-48cc-8666-f1aba1a0243f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:07.340099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:07.350695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 277/565] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:07.351534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34dbdc-80b9-48cc-8666-f1aba1a0243f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:07.374528 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995facd-77ae-4c94-9f38-d303ca665a4f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.407713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f3322-d2dc-4df7-a2b6-835d135eb668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.408331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3322-d2dc-4df7-a2b6-835d135eb668 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.408603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3322-d2dc-4df7-a2b6-835d135eb668 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.408873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3322-d2dc-4df7-a2b6-835d135eb668 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.416126 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f3322-d2dc-4df7-a2b6-835d135eb668 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.417586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f3322-d2dc-4df7-a2b6-835d135eb668 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-1e4f3322-d2dc-4df7-a2b6-835d135eb668 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:07.428604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:07.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 289/566] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:07.436075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f3322-d2dc-4df7-a2b6-835d135eb668 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:07.454682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34dbdc-80b9-48cc-8666-f1aba1a0243f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.488421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2685f71-decb-421b-8527-703442ff9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.489024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2685f71-decb-421b-8527-703442ff9404 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.489298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2685f71-decb-421b-8527-703442ff9404 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.489592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2685f71-decb-421b-8527-703442ff9404 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.490245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2685f71-decb-421b-8527-703442ff9404 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:07.490541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2685f71-decb-421b-8527-703442ff9404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.491907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2685f71-decb-421b-8527-703442ff9404 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:07.499868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 278/567] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:07.501013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a29b9-1767-42ae-bafc-98e07d622c16 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.501295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a29b9-1767-42ae-bafc-98e07d622c16 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.501598 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a29b9-1767-42ae-bafc-98e07d622c16 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.502954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 279/568] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:07.503475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a29b9-1767-42ae-bafc-98e07d622c16 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:07.521830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:07.530884 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f3322-d2dc-4df7-a2b6-835d135eb668 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.563998 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:07.565253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9efbb-0b23-45f0-9d9e-af2834748594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.565906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9efbb-0b23-45f0-9d9e-af2834748594 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.566180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9efbb-0b23-45f0-9d9e-af2834748594 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.566448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9efbb-0b23-45f0-9d9e-af2834748594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.576732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9efbb-0b23-45f0-9d9e-af2834748594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.578216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9efbb-0b23-45f0-9d9e-af2834748594 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c8b9efbb-0b23-45f0-9d9e-af2834748594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:07.593770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:07.594877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:07.595754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:07.595754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:07.595754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:07.595754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 290/569] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:07.595754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9efbb-0b23-45f0-9d9e-af2834748594 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:07.609581 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a29b9-1767-42ae-bafc-98e07d622c16 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.642572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493167d-5427-4a2b-b865-2d543427f687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.643192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493167d-5427-4a2b-b865-2d543427f687 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.643467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493167d-5427-4a2b-b865-2d543427f687 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.643733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493167d-5427-4a2b-b865-2d543427f687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.650691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493167d-5427-4a2b-b865-2d543427f687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.652260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493167d-5427-4a2b-b865-2d543427f687 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-0493167d-5427-4a2b-b865-2d543427f687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:07.663086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:07.664095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:07.665204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:07.665204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:07.665204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:07.665204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:07.665204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:07.665204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:07.665204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:07.665204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:07.669689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 280/570] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:07.670565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493167d-5427-4a2b-b865-2d543427f687 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:07.693054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9efbb-0b23-45f0-9d9e-af2834748594 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.726552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd9636-bd09-4a41-a4e9-5d9d15090c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.727151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd9636-bd09-4a41-a4e9-5d9d15090c78 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.727427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd9636-bd09-4a41-a4e9-5d9d15090c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.727698 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd9636-bd09-4a41-a4e9-5d9d15090c78 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.728680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd9636-bd09-4a41-a4e9-5d9d15090c78 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:07.728984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd9636-bd09-4a41-a4e9-5d9d15090c78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.730443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd9636-bd09-4a41-a4e9-5d9d15090c78 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:07.747989 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 291/571] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:07.749150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69569c-84e8-4db7-b3f4-42ac37ae6bea None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.749462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69569c-84e8-4db7-b3f4-42ac37ae6bea None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.749732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69569c-84e8-4db7-b3f4-42ac37ae6bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.755611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:07.767648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cf69569c-84e8-4db7-b3f4-42ac37ae6bea None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:07.779423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cf69569c-84e8-4db7-b3f4-42ac37ae6bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:07.779549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493167d-5427-4a2b-b865-2d543427f687 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.786284 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:07.802736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012555-5091-465d-a0ac-974bc41d87ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.803359 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012555-5091-465d-a0ac-974bc41d87ee None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.803629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012555-5091-465d-a0ac-974bc41d87ee None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.803900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012555-5091-465d-a0ac-974bc41d87ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.815132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79012555-5091-465d-a0ac-974bc41d87ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.816573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79012555-5091-465d-a0ac-974bc41d87ee None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-79012555-5091-465d-a0ac-974bc41d87ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:07.830483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:07.831642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:07.832770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:07.832770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:07.832770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:07.833612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 281/572] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:07.834486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012555-5091-465d-a0ac-974bc41d87ee None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:07.836114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 292/573] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:07.836967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69569c-84e8-4db7-b3f4-42ac37ae6bea None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:07.943965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012555-5091-465d-a0ac-974bc41d87ee None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.949934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69569c-84e8-4db7-b3f4-42ac37ae6bea None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:07.980777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:07.981975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645b371-d3c7-4f31-9782-ee6d04fead69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.982590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645b371-d3c7-4f31-9782-ee6d04fead69 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.982868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645b371-d3c7-4f31-9782-ee6d04fead69 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.983141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645b371-d3c7-4f31-9782-ee6d04fead69 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.983807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645b371-d3c7-4f31-9782-ee6d04fead69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:07.984105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645b371-d3c7-4f31-9782-ee6d04fead69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.985506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645b371-d3c7-4f31-9782-ee6d04fead69 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:07.985862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2e2fe-2535-4444-b21b-fe8f10b77e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:07.986501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2e2fe-2535-4444-b21b-fe8f10b77e9c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:07.986743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2e2fe-2535-4444-b21b-fe8f10b77e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:07.987020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2e2fe-2535-4444-b21b-fe8f10b77e9c None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:07.987703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2e2fe-2535-4444-b21b-fe8f10b77e9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:07.988010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2e2fe-2535-4444-b21b-fe8f10b77e9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:07.989438 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2e2fe-2535-4444-b21b-fe8f10b77e9c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:08.003541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 282/574] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:08.003541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645b371-d3c7-4f31-9782-ee6d04fead69 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.003788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 293/575] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:08.003788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2e2fe-2535-4444-b21b-fe8f10b77e9c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.034137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:08.107143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2e2fe-2535-4444-b21b-fe8f10b77e9c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.116092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645b371-d3c7-4f31-9782-ee6d04fead69 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.140168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac13f15-9715-408c-9030-2d89ed03cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:08.140771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac13f15-9715-408c-9030-2d89ed03cee2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:08.141049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac13f15-9715-408c-9030-2d89ed03cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:08.141320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac13f15-9715-408c-9030-2d89ed03cee2 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:08.141988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac13f15-9715-408c-9030-2d89ed03cee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:08.142291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac13f15-9715-408c-9030-2d89ed03cee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:08.143669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac13f15-9715-408c-9030-2d89ed03cee2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:08.150206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ea55c-6f83-4e9a-b853-c3195b9d0bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:08.150847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea55c-6f83-4e9a-b853-c3195b9d0bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:08.151118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea55c-6f83-4e9a-b853-c3195b9d0bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:08.151381 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea55c-6f83-4e9a-b853-c3195b9d0bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:08.155308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 294/576] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:08.156090 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac13f15-9715-408c-9030-2d89ed03cee2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.162798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ea55c-6f83-4e9a-b853-c3195b9d0bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:08.164211 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ea55c-6f83-4e9a-b853-c3195b9d0bd9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-963ea55c-6f83-4e9a-b853-c3195b9d0bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:08.178876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:08.179802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:08.180688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:08.180688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:08.180688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:08.180688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 283/577] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:08.180688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ea55c-6f83-4e9a-b853-c3195b9d0bd9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.215367 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:08.261553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:08.261962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac13f15-9715-408c-9030-2d89ed03cee2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.279174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ea55c-6f83-4e9a-b853-c3195b9d0bd9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.295688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a95a0c-4f4e-441e-a97d-9602cee411ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:08.296251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95a0c-4f4e-441e-a97d-9602cee411ed None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:08.296526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95a0c-4f4e-441e-a97d-9602cee411ed None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:08.296798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95a0c-4f4e-441e-a97d-9602cee411ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:08.304012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a95a0c-4f4e-441e-a97d-9602cee411ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:08.305504 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a95a0c-4f4e-441e-a97d-9602cee411ed None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:08.312861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6385ec-d0a5-4a41-b279-d2003a6d27b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:08.313479 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6385ec-d0a5-4a41-b279-d2003a6d27b8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:08.313756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6385ec-d0a5-4a41-b279-d2003a6d27b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:08.314020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6385ec-d0a5-4a41-b279-d2003a6d27b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:08.314730 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6385ec-d0a5-4a41-b279-d2003a6d27b8 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=6a2326353998441c938abf274b5e5dd4) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:08.315031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6385ec-d0a5-4a41-b279-d2003a6d27b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:08.316427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6385ec-d0a5-4a41-b279-d2003a6d27b8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f9a95a0c-4f4e-441e-a97d-9602cee411ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:08.316531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:08.317622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 295/578] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 17 16:06:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:08.318589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a95a0c-4f4e-441e-a97d-9602cee411ed None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.325591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 284/579] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:08 2022] GET /identity/v3/role_assignments?user.id=6a2326353998441c938abf274b5e5dd4&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:08.326380 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6385ec-d0a5-4a41-b279-d2003a6d27b8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.445882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6385ec-d0a5-4a41-b279-d2003a6d27b8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.446194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a95a0c-4f4e-441e-a97d-9602cee411ed None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.460839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:08.484648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aaeaf-0b47-4ef5-b723-44462695f0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:08.484882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611abb-7a75-4f35-8770-8d9be753a762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:08.485290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aaeaf-0b47-4ef5-b723-44462695f0ce None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:08.485420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611abb-7a75-4f35-8770-8d9be753a762 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:08.485597 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aaeaf-0b47-4ef5-b723-44462695f0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:08.485708 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611abb-7a75-4f35-8770-8d9be753a762 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:08.485865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aaeaf-0b47-4ef5-b723-44462695f0ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:08.485967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611abb-7a75-4f35-8770-8d9be753a762 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:08.493736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89611abb-7a75-4f35-8770-8d9be753a762 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:08.495883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89611abb-7a75-4f35-8770-8d9be753a762 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:08.498051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9aaeaf-0b47-4ef5-b723-44462695f0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0f9aaeaf-0b47-4ef5-b723-44462695f0ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:08.503997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:08.505112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:08.506043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 296/580] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:08.506724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aaeaf-0b47-4ef5-b723-44462695f0ce None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-89611abb-7a75-4f35-8770-8d9be753a762 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:08.512986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:08.514242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:08.515389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:08.515389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:08.515389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:08.515389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:08.515389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:08.515389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:08.515389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:08.515389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:08.515389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:06:08.515389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:08.518761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 285/581] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:08.519410 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611abb-7a75-4f35-8770-8d9be753a762 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.529448 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:08.621731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aaeaf-0b47-4ef5-b723-44462695f0ce None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.633343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611abb-7a75-4f35-8770-8d9be753a762 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.659326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5483c-348e-4dc1-9fb9-9597f214dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:08.660053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5483c-348e-4dc1-9fb9-9597f214dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:08.660334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5483c-348e-4dc1-9fb9-9597f214dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:08.660608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5483c-348e-4dc1-9fb9-9597f214dfb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:08.661250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5483c-348e-4dc1-9fb9-9597f214dfb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:08.661579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5483c-348e-4dc1-9fb9-9597f214dfb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:08.663332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5483c-348e-4dc1-9fb9-9597f214dfb2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:08.667502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be129d-952b-4102-bbb2-3aaa8cdbb7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:08.668101 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be129d-952b-4102-bbb2-3aaa8cdbb7bd None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:08.668372 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be129d-952b-4102-bbb2-3aaa8cdbb7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:08.668634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be129d-952b-4102-bbb2-3aaa8cdbb7bd None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:08.669343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be129d-952b-4102-bbb2-3aaa8cdbb7bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:08.669669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be129d-952b-4102-bbb2-3aaa8cdbb7bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:08.671059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be129d-952b-4102-bbb2-3aaa8cdbb7bd None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:08.681069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 297/582] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:08.681069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5483c-348e-4dc1-9fb9-9597f214dfb2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.690028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 286/583] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 17 16:06:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:08.691110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be129d-952b-4102-bbb2-3aaa8cdbb7bd None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.714457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:08.760074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:08.789399 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5483c-348e-4dc1-9fb9-9597f214dfb2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.799315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be129d-952b-4102-bbb2-3aaa8cdbb7bd None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.825706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fb7be-f288-4c69-9e9a-1ce2d84814ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:08.826468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fb7be-f288-4c69-9e9a-1ce2d84814ac None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:08.826848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fb7be-f288-4c69-9e9a-1ce2d84814ac None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:08.827214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fb7be-f288-4c69-9e9a-1ce2d84814ac None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:08.827971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fb7be-f288-4c69-9e9a-1ce2d84814ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:08.828367 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fb7be-f288-4c69-9e9a-1ce2d84814ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:08.829839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fb7be-f288-4c69-9e9a-1ce2d84814ac None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:08.835737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6400e8-f17c-4b90-b23b-abdc1f328fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:08.836405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6400e8-f17c-4b90-b23b-abdc1f328fca None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:08.836758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6400e8-f17c-4b90-b23b-abdc1f328fca None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:08.837131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6400e8-f17c-4b90-b23b-abdc1f328fca None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:08.838483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6400e8-f17c-4b90-b23b-abdc1f328fca None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:08.843449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6400e8-f17c-4b90-b23b-abdc1f328fca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:08.843585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 298/584] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:08.843585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fb7be-f288-4c69-9e9a-1ce2d84814ac None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.843770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6400e8-f17c-4b90-b23b-abdc1f328fca None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:08.863977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 287/585] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 17 16:06:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:08.863977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6400e8-f17c-4b90-b23b-abdc1f328fca None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:08.951351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:08.958158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fb7be-f288-4c69-9e9a-1ce2d84814ac None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.976207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6400e8-f17c-4b90-b23b-abdc1f328fca None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:08.995778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd74ad-099e-4c4f-ae08-940e330de9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:08.996414 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd74ad-099e-4c4f-ae08-940e330de9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:08.996692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd74ad-099e-4c4f-ae08-940e330de9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:08.996964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd74ad-099e-4c4f-ae08-940e330de9c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.000938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:09.004082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd74ad-099e-4c4f-ae08-940e330de9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.005576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd74ad-099e-4c4f-ae08-940e330de9c8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.014024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3db998-3df4-4a21-a28c-73db88f981fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.014956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3db998-3df4-4a21-a28c-73db88f981fc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.014956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3db998-3df4-4a21-a28c-73db88f981fc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.015219 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3db998-3df4-4a21-a28c-73db88f981fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-57dd74ad-099e-4c4f-ae08-940e330de9c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:09.017980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:09.018843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:09.019731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:09.019731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:09.019731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:09.019731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:09.019731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:09.019731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:09.019731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:09.019731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:09.019731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 299/586] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:09.020214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd74ad-099e-4c4f-ae08-940e330de9c8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.028133 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3db998-3df4-4a21-a28c-73db88f981fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.029628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3db998-3df4-4a21-a28c-73db88f981fc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-cb3db998-3df4-4a21-a28c-73db88f981fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:09.046987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:09.047918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:09.048793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:09.048793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:09.048793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:09.050336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 288/587] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:09.051247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3db998-3df4-4a21-a28c-73db88f981fc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.129329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd74ad-099e-4c4f-ae08-940e330de9c8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.160570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3db998-3df4-4a21-a28c-73db88f981fc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.166885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63486b42-9ec3-4cd1-a807-2801fed9faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.167717 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63486b42-9ec3-4cd1-a807-2801fed9faf7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.167996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63486b42-9ec3-4cd1-a807-2801fed9faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.168270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63486b42-9ec3-4cd1-a807-2801fed9faf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.178797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63486b42-9ec3-4cd1-a807-2801fed9faf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.180315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63486b42-9ec3-4cd1-a807-2801fed9faf7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.196016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2a4b7-a65d-4150-98b7-b91e6e75173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-63486b42-9ec3-4cd1-a807-2801fed9faf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:09.197222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:09.203192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:09.204275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:09.204275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:09.204275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:09.204491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2a4b7-a65d-4150-98b7-b91e6e75173d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.204491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2a4b7-a65d-4150-98b7-b91e6e75173d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.204491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2a4b7-a65d-4150-98b7-b91e6e75173d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.204703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 300/588] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:09.204703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63486b42-9ec3-4cd1-a807-2801fed9faf7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.211562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:09.216081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2a4b7-a65d-4150-98b7-b91e6e75173d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.217631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2a4b7-a65d-4150-98b7-b91e6e75173d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-5ea2a4b7-a65d-4150-98b7-b91e6e75173d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:09.233159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:09.239067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:09.240167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:09.240167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:09.240167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:09.240167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 289/589] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:09.240167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2a4b7-a65d-4150-98b7-b91e6e75173d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.272918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:09.316762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63486b42-9ec3-4cd1-a807-2801fed9faf7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.351699 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2a4b7-a65d-4150-98b7-b91e6e75173d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.354169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ef3cd-76cd-4fb7-afb9-a32036d301a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.354785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ef3cd-76cd-4fb7-afb9-a32036d301a0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.355067 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ef3cd-76cd-4fb7-afb9-a32036d301a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.355345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ef3cd-76cd-4fb7-afb9-a32036d301a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.356035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ef3cd-76cd-4fb7-afb9-a32036d301a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:09.356340 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ef3cd-76cd-4fb7-afb9-a32036d301a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.357847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ef3cd-76cd-4fb7-afb9-a32036d301a0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.370668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 301/590] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:09.371506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ef3cd-76cd-4fb7-afb9-a32036d301a0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.396481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f6dcb-18e3-456b-bd97-d79e8fb3d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.397242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6dcb-18e3-456b-bd97-d79e8fb3d977 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.397643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6dcb-18e3-456b-bd97-d79e8fb3d977 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.398022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f6dcb-18e3-456b-bd97-d79e8fb3d977 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.398763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f6dcb-18e3-456b-bd97-d79e8fb3d977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:09.399141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f6dcb-18e3-456b-bd97-d79e8fb3d977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.400541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f6dcb-18e3-456b-bd97-d79e8fb3d977 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.416811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 290/591] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:09.416811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f6dcb-18e3-456b-bd97-d79e8fb3d977 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.446384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:09.484689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ef3cd-76cd-4fb7-afb9-a32036d301a0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.504133 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:09.519544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f6dcb-18e3-456b-bd97-d79e8fb3d977 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.520523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0b23-ed28-4537-8891-0449f2499840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.521195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0b23-ed28-4537-8891-0449f2499840 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.521605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0b23-ed28-4537-8891-0449f2499840 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.521951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0b23-ed28-4537-8891-0449f2499840 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.522639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c0b23-ed28-4537-8891-0449f2499840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:09.522954 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c0b23-ed28-4537-8891-0449f2499840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.524411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c0b23-ed28-4537-8891-0449f2499840 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.536326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 302/592] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:09.537294 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0b23-ed28-4537-8891-0449f2499840 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.560019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98ee5c-2450-44be-88e4-2a1130d24459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.560790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98ee5c-2450-44be-88e4-2a1130d24459 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.561166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98ee5c-2450-44be-88e4-2a1130d24459 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.561563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98ee5c-2450-44be-88e4-2a1130d24459 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.562306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98ee5c-2450-44be-88e4-2a1130d24459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:09.562709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98ee5c-2450-44be-88e4-2a1130d24459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.564173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98ee5c-2450-44be-88e4-2a1130d24459 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.580559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 291/593] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:09.580559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98ee5c-2450-44be-88e4-2a1130d24459 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.649924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c0b23-ed28-4537-8891-0449f2499840 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.678432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:09.686931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98ee5c-2450-44be-88e4-2a1130d24459 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.687350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b190dd2-b17a-4d6a-b881-4b1852c16c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.688006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b190dd2-b17a-4d6a-b881-4b1852c16c05 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.688635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b190dd2-b17a-4d6a-b881-4b1852c16c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.688635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b190dd2-b17a-4d6a-b881-4b1852c16c05 None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/e9b8a5b38ac046ed8e8b98f0ecefb07f/roles/2da610f1e24748d597d353508d98c21e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.704235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b190dd2-b17a-4d6a-b881-4b1852c16c05 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=e9b8a5b38ac046ed8e8b98f0ecefb07f, role_id=2da610f1e24748d597d353508d98c21e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.705732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b190dd2-b17a-4d6a-b881-4b1852c16c05 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.723602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f69b2-0aab-4b95-80c8-96ffff5de67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.724321 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f69b2-0aab-4b95-80c8-96ffff5de67f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.724596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f69b2-0aab-4b95-80c8-96ffff5de67f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.724861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f69b2-0aab-4b95-80c8-96ffff5de67f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.732074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f69b2-0aab-4b95-80c8-96ffff5de67f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.733524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f69b2-0aab-4b95-80c8-96ffff5de67f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-2c5f69b2-0aab-4b95-80c8-96ffff5de67f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:09.744627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:09.745696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:09.746711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:09.746711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:09.746711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:09.746711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:09.746711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:09.746711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:09.746711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:09.746711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:09.746711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 292/594] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:09.746711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f69b2-0aab-4b95-80c8-96ffff5de67f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.758115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:09.777396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 303/595] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:06:09 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/e9b8a5b38ac046ed8e8b98f0ecefb07f/roles/2da610f1e24748d597d353508d98c21e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:06:09.777396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b190dd2-b17a-4d6a-b881-4b1852c16c05 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.865311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f69b2-0aab-4b95-80c8-96ffff5de67f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.911260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506fa49-ddff-4193-8bb7-03f65581bf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.912318 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506fa49-ddff-4193-8bb7-03f65581bf19 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.913110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506fa49-ddff-4193-8bb7-03f65581bf19 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.913522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506fa49-ddff-4193-8bb7-03f65581bf19 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.924488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506fa49-ddff-4193-8bb7-03f65581bf19 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.927470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506fa49-ddff-4193-8bb7-03f65581bf19 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.935668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b190dd2-b17a-4d6a-b881-4b1852c16c05 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b506fa49-ddff-4193-8bb7-03f65581bf19 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:09.940552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:09.941588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:09.942585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:09.942585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:09.942585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:09.942585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:09.942585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:09.942585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:09.942585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:09.942585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:09.942585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:06:09.942585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:09.942585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 293/596] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:09.943176 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506fa49-ddff-4193-8bb7-03f65581bf19 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.984370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838385c-27db-42d1-bfdb-f3d3dbda5be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.985486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838385c-27db-42d1-bfdb-f3d3dbda5be7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.985896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838385c-27db-42d1-bfdb-f3d3dbda5be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.987157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838385c-27db-42d1-bfdb-f3d3dbda5be7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.996302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838385c-27db-42d1-bfdb-f3d3dbda5be7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.998617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838385c-27db-42d1-bfdb-f3d3dbda5be7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-4838385c-27db-42d1-bfdb-f3d3dbda5be7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:10.015422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:10.016581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:10.017701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:10.017701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:10.017701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:10.017701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:10.017701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:10.017701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:10.017701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:10.017701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:10.018915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 304/597] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:10.020029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838385c-27db-42d1-bfdb-f3d3dbda5be7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.025754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:10.063934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506fa49-ddff-4193-8bb7-03f65581bf19 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.068023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:10.104012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307d3b-5720-41d4-892f-c82a08b66ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:10.104930 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307d3b-5720-41d4-892f-c82a08b66ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.105419 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307d3b-5720-41d4-892f-c82a08b66ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.105893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307d3b-5720-41d4-892f-c82a08b66ae5 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.106758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307d3b-5720-41d4-892f-c82a08b66ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:10.107251 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307d3b-5720-41d4-892f-c82a08b66ae5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:10.108855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307d3b-5720-41d4-892f-c82a08b66ae5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.128066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 294/598] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:10.129282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307d3b-5720-41d4-892f-c82a08b66ae5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.151363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838385c-27db-42d1-bfdb-f3d3dbda5be7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.188272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd5133-5aa9-4f32-a7ff-7ec0248da5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:10.189190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd5133-5aa9-4f32-a7ff-7ec0248da5fc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.189687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd5133-5aa9-4f32-a7ff-7ec0248da5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.190138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd5133-5aa9-4f32-a7ff-7ec0248da5fc None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.191152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd5133-5aa9-4f32-a7ff-7ec0248da5fc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:10.191635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd5133-5aa9-4f32-a7ff-7ec0248da5fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:10.193270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd5133-5aa9-4f32-a7ff-7ec0248da5fc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.218622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 305/599] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 17 16:06:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:10.219799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd5133-5aa9-4f32-a7ff-7ec0248da5fc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.258828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307d3b-5720-41d4-892f-c82a08b66ae5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.287804 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:10.296658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae432-1990-4b48-978e-25614121c7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:10.297275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae432-1990-4b48-978e-25614121c7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.309455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae432-1990-4b48-978e-25614121c7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.309455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eae432-1990-4b48-978e-25614121c7e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.309455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eae432-1990-4b48-978e-25614121c7e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:10.309455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eae432-1990-4b48-978e-25614121c7e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:10.309455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eae432-1990-4b48-978e-25614121c7e3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.312064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 295/600] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:10.312934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae432-1990-4b48-978e-25614121c7e3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.330447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:10.336970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd5133-5aa9-4f32-a7ff-7ec0248da5fc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.373677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868212d-4b32-4ab8-a8b3-ba66fa0e5178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:10.374324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868212d-4b32-4ab8-a8b3-ba66fa0e5178 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.374602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868212d-4b32-4ab8-a8b3-ba66fa0e5178 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.374871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868212d-4b32-4ab8-a8b3-ba66fa0e5178 None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/f99edbaee8504487863c6fa4b551c224/roles/2da610f1e24748d597d353508d98c21e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.390600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868212d-4b32-4ab8-a8b3-ba66fa0e5178 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=f99edbaee8504487863c6fa4b551c224, role_id=2da610f1e24748d597d353508d98c21e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:10.392056 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868212d-4b32-4ab8-a8b3-ba66fa0e5178 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.418185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eae432-1990-4b48-978e-25614121c7e3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.452721 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cfb83-78be-41a9-a9ba-98687db60e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:10.453278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cfb83-78be-41a9-a9ba-98687db60e85 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.453585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cfb83-78be-41a9-a9ba-98687db60e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.453866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cfb83-78be-41a9-a9ba-98687db60e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.465097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cfb83-78be-41a9-a9ba-98687db60e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:10.466577 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cfb83-78be-41a9-a9ba-98687db60e85 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.469100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 306/601] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:06:10 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/f99edbaee8504487863c6fa4b551c224/roles/2da610f1e24748d597d353508d98c21e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:06:10.470373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaad584-6dea-41e3-aa6d-4e652d29bf3a None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.470655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaad584-6dea-41e3-aa6d-4e652d29bf3a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.470933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaad584-6dea-41e3-aa6d-4e652d29bf3a None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.476646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 307/602] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:10.476646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaad584-6dea-41e3-aa6d-4e652d29bf3a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-274cfb83-78be-41a9-a9ba-98687db60e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:10.491264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:10.492276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:10.493138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:10.493138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:10.493138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:10.495909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 296/603] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:10.497743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00bf3-586c-4e1a-859f-f7a40ae650d5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.498230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00bf3-586c-4e1a-859f-f7a40ae650d5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.498694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00bf3-586c-4e1a-859f-f7a40ae650d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.520099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f6b00bf3-586c-4e1a-859f-f7a40ae650d5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:10.522046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f6b00bf3-586c-4e1a-859f-f7a40ae650d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:10.558680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:10.601166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaad584-6dea-41e3-aa6d-4e652d29bf3a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.609781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 297/604] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:10.611100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00bf3-586c-4e1a-859f-f7a40ae650d5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.644155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a20b3-3ea5-4a26-bf42-c5ed6b89e929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:10.645139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a20b3-3ea5-4a26-bf42-c5ed6b89e929 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.645534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a20b3-3ea5-4a26-bf42-c5ed6b89e929 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.645813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a20b3-3ea5-4a26-bf42-c5ed6b89e929 None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/4227da1895a94c9c845c4f7adf838144/roles/2da610f1e24748d597d353508d98c21e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.663757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a20b3-3ea5-4a26-bf42-c5ed6b89e929 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=4227da1895a94c9c845c4f7adf838144, role_id=2da610f1e24748d597d353508d98c21e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:10.665593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a20b3-3ea5-4a26-bf42-c5ed6b89e929 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.668398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:10.731181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00bf3-586c-4e1a-859f-f7a40ae650d5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.764773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 308/605] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:06:10 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/4227da1895a94c9c845c4f7adf838144/roles/2da610f1e24748d597d353508d98c21e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:06:10.772164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1f501-597c-4ced-9918-6fbe7f584002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:10.772820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f501-597c-4ced-9918-6fbe7f584002 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.773081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f501-597c-4ced-9918-6fbe7f584002 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.773347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f501-597c-4ced-9918-6fbe7f584002 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.774051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1f501-597c-4ced-9918-6fbe7f584002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:10.774355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1f501-597c-4ced-9918-6fbe7f584002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:10.776362 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1f501-597c-4ced-9918-6fbe7f584002 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.789997 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 298/606] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:10.796491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a20b3-3ea5-4a26-bf42-c5ed6b89e929 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.951158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1f501-597c-4ced-9918-6fbe7f584002 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.973319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a20b3-3ea5-4a26-bf42-c5ed6b89e929 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.992347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:11.017180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32946a58-e00e-44ad-b2ef-9723a12b6300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.018319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32946a58-e00e-44ad-b2ef-9723a12b6300 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.018816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32946a58-e00e-44ad-b2ef-9723a12b6300 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.019327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32946a58-e00e-44ad-b2ef-9723a12b6300 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.028931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32946a58-e00e-44ad-b2ef-9723a12b6300 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:11.030961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32946a58-e00e-44ad-b2ef-9723a12b6300 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-32946a58-e00e-44ad-b2ef-9723a12b6300 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:11.045105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:11.046074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:11.046946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:11.046946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:11.046946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:11.046946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:11.046946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:11.046946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:11.046946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:11.046946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:11.049434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 309/607] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:11.055368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32946a58-e00e-44ad-b2ef-9723a12b6300 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:11.094439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1f501-597c-4ced-9918-6fbe7f584002 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:11.139314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:11.155831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674de9c1-1863-4e76-8b70-edaf6b52fe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.158466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674de9c1-1863-4e76-8b70-edaf6b52fe7a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.158753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674de9c1-1863-4e76-8b70-edaf6b52fe7a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.159018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674de9c1-1863-4e76-8b70-edaf6b52fe7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.189749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674de9c1-1863-4e76-8b70-edaf6b52fe7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-674de9c1-1863-4e76-8b70-edaf6b52fe7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:11.196537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:11.197707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:11.199046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:11.205508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 299/608] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:11.219192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674de9c1-1863-4e76-8b70-edaf6b52fe7a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:11.233962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32946a58-e00e-44ad-b2ef-9723a12b6300 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:11.301351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e218-e09a-431c-876d-d0e837307b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.302407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e218-e09a-431c-876d-d0e837307b5b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.303759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e218-e09a-431c-876d-d0e837307b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.305045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e218-e09a-431c-876d-d0e837307b5b None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.306036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41e218-e09a-431c-876d-d0e837307b5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:11.306995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41e218-e09a-431c-876d-d0e837307b5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:11.310080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41e218-e09a-431c-876d-d0e837307b5b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:11.334656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 310/609] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:11.341158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e218-e09a-431c-876d-d0e837307b5b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:11.387850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:11.412033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674de9c1-1863-4e76-8b70-edaf6b52fe7a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:11.477312 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154edf7-5b67-4edd-b003-55d2e6e422ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.478894 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154edf7-5b67-4edd-b003-55d2e6e422ef None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.480425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154edf7-5b67-4edd-b003-55d2e6e422ef None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.481562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154edf7-5b67-4edd-b003-55d2e6e422ef None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.483667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154edf7-5b67-4edd-b003-55d2e6e422ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:11.484191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154edf7-5b67-4edd-b003-55d2e6e422ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:11.485804 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154edf7-5b67-4edd-b003-55d2e6e422ef None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:11.499045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 300/610] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:11.504817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154edf7-5b67-4edd-b003-55d2e6e422ef None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:11.505988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e218-e09a-431c-876d-d0e837307b5b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:11.541730 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:11.564965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96318098-f222-4f61-b7d2-458390bafe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.565590 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318098-f222-4f61-b7d2-458390bafe8f None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.565871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318098-f222-4f61-b7d2-458390bafe8f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.566147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318098-f222-4f61-b7d2-458390bafe8f None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/4ad54a22e6e747d9887c82bb62a923da/roles/2da610f1e24748d597d353508d98c21e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.595054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96318098-f222-4f61-b7d2-458390bafe8f None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=4ad54a22e6e747d9887c82bb62a923da, role_id=2da610f1e24748d597d353508d98c21e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:11.602509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96318098-f222-4f61-b7d2-458390bafe8f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:11.617925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154edf7-5b67-4edd-b003-55d2e6e422ef None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:11.656841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe00a09-ff73-4b7b-8fd3-db3f7b987632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.657910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00a09-ff73-4b7b-8fd3-db3f7b987632 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.658397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00a09-ff73-4b7b-8fd3-db3f7b987632 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.658870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00a09-ff73-4b7b-8fd3-db3f7b987632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.671128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe00a09-ff73-4b7b-8fd3-db3f7b987632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:11.673000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe00a09-ff73-4b7b-8fd3-db3f7b987632 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:11.686572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 311/611] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:06:11 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/4ad54a22e6e747d9887c82bb62a923da/roles/2da610f1e24748d597d353508d98c21e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-bbe00a09-ff73-4b7b-8fd3-db3f7b987632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:11.689466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:11.695531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:11.696985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:11.696985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:11.696985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:11.696985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 301/612] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:11.701199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96318098-f222-4f61-b7d2-458390bafe8f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:11.831210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96318098-f222-4f61-b7d2-458390bafe8f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:11.881321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44930e7-480b-49af-a965-95bb5f9d7aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.882432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44930e7-480b-49af-a965-95bb5f9d7aec None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.882977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44930e7-480b-49af-a965-95bb5f9d7aec None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.883454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44930e7-480b-49af-a965-95bb5f9d7aec None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.884895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44930e7-480b-49af-a965-95bb5f9d7aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:11.885577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44930e7-480b-49af-a965-95bb5f9d7aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:11.887223 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44930e7-480b-49af-a965-95bb5f9d7aec None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:11.911965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 312/613] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:11.918171 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe00a09-ff73-4b7b-8fd3-db3f7b987632 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:11.921657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:12.039547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe00a09-ff73-4b7b-8fd3-db3f7b987632 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:12.049341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d89c7e-7780-4d3e-bc48-b65bfd976158 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:12.049646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d89c7e-7780-4d3e-bc48-b65bfd976158 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:12.049923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d89c7e-7780-4d3e-bc48-b65bfd976158 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:12.051418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 313/614] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:12.057639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827714-bbf4-4b92-89e0-3c61ee8b715d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:12.058250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827714-bbf4-4b92-89e0-3c61ee8b715d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:12.058758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827714-bbf4-4b92-89e0-3c61ee8b715d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:12.078119 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-02827714-bbf4-4b92-89e0-3c61ee8b715d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:12.079638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-02827714-bbf4-4b92-89e0-3c61ee8b715d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:12.094640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103a9c4-b3be-4749-887a-949ccbc0a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:12.095694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103a9c4-b3be-4749-887a-949ccbc0a43c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:12.096177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103a9c4-b3be-4749-887a-949ccbc0a43c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:12.096647 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103a9c4-b3be-4749-887a-949ccbc0a43c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:12.113877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103a9c4-b3be-4749-887a-949ccbc0a43c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:12.117631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103a9c4-b3be-4749-887a-949ccbc0a43c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:12.124244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-1103a9c4-b3be-4749-887a-949ccbc0a43c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:12.143457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:12.144517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:12.145517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:12.145517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:12.145517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:12.145517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:12.145517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:12.145517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:12.145517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:12.145517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:12.145517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:12.145517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:12.151386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 302/615] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:12.154935 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103a9c4-b3be-4749-887a-949ccbc0a43c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:12.234175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 314/616] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:12.262188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:12.315704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103a9c4-b3be-4749-887a-949ccbc0a43c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:12.363986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa815f-37ee-42ec-b08c-44ce81596e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:12.364976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa815f-37ee-42ec-b08c-44ce81596e2a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:12.365483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa815f-37ee-42ec-b08c-44ce81596e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:12.365976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa815f-37ee-42ec-b08c-44ce81596e2a None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:12.366926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa815f-37ee-42ec-b08c-44ce81596e2a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:12.367429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa815f-37ee-42ec-b08c-44ce81596e2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:12.370133 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa815f-37ee-42ec-b08c-44ce81596e2a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:12.395617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 303/617] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 17 16:06:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:12.401291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827714-bbf4-4b92-89e0-3c61ee8b715d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:12.551008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827714-bbf4-4b92-89e0-3c61ee8b715d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:12.599496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22883ee-89d8-40d1-8651-c5e14a1614cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:12.600135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22883ee-89d8-40d1-8651-c5e14a1614cc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:12.600415 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22883ee-89d8-40d1-8651-c5e14a1614cc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:12.600685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22883ee-89d8-40d1-8651-c5e14a1614cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:12.615425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22883ee-89d8-40d1-8651-c5e14a1614cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:12.616822 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22883ee-89d8-40d1-8651-c5e14a1614cc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:12.626646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa815f-37ee-42ec-b08c-44ce81596e2a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a22883ee-89d8-40d1-8651-c5e14a1614cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:12.640087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:12.641100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:12.642125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:12.642125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:12.642125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:12.642125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 315/618] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:12.649333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22883ee-89d8-40d1-8651-c5e14a1614cc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:12.673706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:12.777032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22883ee-89d8-40d1-8651-c5e14a1614cc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:12.835288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa815f-37ee-42ec-b08c-44ce81596e2a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:12.846628 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69519e-ad93-4a89-bd69-0006ac979e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:12.847560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69519e-ad93-4a89-bd69-0006ac979e7e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:12.848065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69519e-ad93-4a89-bd69-0006ac979e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:12.848547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69519e-ad93-4a89-bd69-0006ac979e7e None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:12.849992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69519e-ad93-4a89-bd69-0006ac979e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:12.850506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69519e-ad93-4a89-bd69-0006ac979e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:12.852093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69519e-ad93-4a89-bd69-0006ac979e7e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:12.868242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 316/619] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:12.873710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69519e-ad93-4a89-bd69-0006ac979e7e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:12.880383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:12.922481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b72877-9cbb-4b65-a650-d4d2cd9a1743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:12.923138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b72877-9cbb-4b65-a650-d4d2cd9a1743 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:12.923418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b72877-9cbb-4b65-a650-d4d2cd9a1743 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:12.923693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b72877-9cbb-4b65-a650-d4d2cd9a1743 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:12.950307 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b72877-9cbb-4b65-a650-d4d2cd9a1743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f6b72877-9cbb-4b65-a650-d4d2cd9a1743 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:12.958497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:12.959465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:12.960350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:12.964644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 304/620] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:12.966150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbda15-74fd-4bf6-9257-f2bbb08bd074 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:12.970701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbda15-74fd-4bf6-9257-f2bbb08bd074 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:12.970701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbda15-74fd-4bf6-9257-f2bbb08bd074 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:12.970701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 305/621] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:12.972739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbda15-74fd-4bf6-9257-f2bbb08bd074 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:12.986692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:13.025142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69519e-ad93-4a89-bd69-0006ac979e7e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:13.063368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98544c8a-55ce-45bf-96a2-40e553b36faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:13.064102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98544c8a-55ce-45bf-96a2-40e553b36faa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.064380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98544c8a-55ce-45bf-96a2-40e553b36faa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.064654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98544c8a-55ce-45bf-96a2-40e553b36faa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.072641 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98544c8a-55ce-45bf-96a2-40e553b36faa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:13.074130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98544c8a-55ce-45bf-96a2-40e553b36faa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:13.085097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbda15-74fd-4bf6-9257-f2bbb08bd074 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-98544c8a-55ce-45bf-96a2-40e553b36faa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:13.086074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:13.087639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:13.088624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:13.088624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:13.088624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:13.088624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:13.088624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:13.088624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:13.088624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:13.088624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:13.088624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 317/622] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:13.089129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6f759-94ef-45ac-817e-5a035d8e8f8f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.089212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6f759-94ef-45ac-817e-5a035d8e8f8f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.089919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6f759-94ef-45ac-817e-5a035d8e8f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.106849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-15d6f759-94ef-45ac-817e-5a035d8e8f8f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:13.108034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-15d6f759-94ef-45ac-817e-5a035d8e8f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:13.129249 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51b862-f5d1-4909-b054-935fb372236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:13.130238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51b862-f5d1-4909-b054-935fb372236a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.130546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51b862-f5d1-4909-b054-935fb372236a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.130821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51b862-f5d1-4909-b054-935fb372236a None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.131506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51b862-f5d1-4909-b054-935fb372236a None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:13.131798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51b862-f5d1-4909-b054-935fb372236a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:13.133176 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51b862-f5d1-4909-b054-935fb372236a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:13.142445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 306/623] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:13.143615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88998-8a44-4264-ac6b-4afba242d4d6 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.143899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88998-8a44-4264-ac6b-4afba242d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.144170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88998-8a44-4264-ac6b-4afba242d4d6 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.145660 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 307/624] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:13.146365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee88998-8a44-4264-ac6b-4afba242d4d6 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:13.188788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 318/625] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:13.189663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6f759-94ef-45ac-817e-5a035d8e8f8f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:13.205250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:13.249804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:13.270124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee88998-8a44-4264-ac6b-4afba242d4d6 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:13.295406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6f759-94ef-45ac-817e-5a035d8e8f8f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:13.306392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70657cae-0e25-46bc-9bb6-52eba196f8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:13.307428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70657cae-0e25-46bc-9bb6-52eba196f8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.307977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70657cae-0e25-46bc-9bb6-52eba196f8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.308456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70657cae-0e25-46bc-9bb6-52eba196f8d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.309423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70657cae-0e25-46bc-9bb6-52eba196f8d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:13.309937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70657cae-0e25-46bc-9bb6-52eba196f8d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:13.311605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70657cae-0e25-46bc-9bb6-52eba196f8d9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:13.325448 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 308/626] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:13.326985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b71703-33e3-4797-996b-938cec9b0720 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.327488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b71703-33e3-4797-996b-938cec9b0720 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.327955 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b71703-33e3-4797-996b-938cec9b0720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.336260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54b7b6-c979-4e44-8827-0fb6d8b98625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:13.336867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54b7b6-c979-4e44-8827-0fb6d8b98625 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.337848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54b7b6-c979-4e44-8827-0fb6d8b98625 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.338344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54b7b6-c979-4e44-8827-0fb6d8b98625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.348234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c5b71703-33e3-4797-996b-938cec9b0720 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:13.348936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54b7b6-c979-4e44-8827-0fb6d8b98625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:13.349915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c5b71703-33e3-4797-996b-938cec9b0720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:13.350532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54b7b6-c979-4e44-8827-0fb6d8b98625 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7f54b7b6-c979-4e44-8827-0fb6d8b98625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:13.366208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:13.367175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:13.368999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:13.368999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:13.368999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:13.368999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 319/627] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:13.368999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54b7b6-c979-4e44-8827-0fb6d8b98625 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:13.424420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 309/628] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:13.426063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b71703-33e3-4797-996b-938cec9b0720 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:13.458255 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:13.502664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54b7b6-c979-4e44-8827-0fb6d8b98625 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:13.512839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:13.531396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b71703-33e3-4797-996b-938cec9b0720 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:13.539690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117f077-36a5-48bb-9fd5-7618ee0d9dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:13.540599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f077-36a5-48bb-9fd5-7618ee0d9dbf None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.542105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f077-36a5-48bb-9fd5-7618ee0d9dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.542539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f077-36a5-48bb-9fd5-7618ee0d9dbf None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/6a2326353998441c938abf274b5e5dd4/roles/2da610f1e24748d597d353508d98c21e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.558863 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117f077-36a5-48bb-9fd5-7618ee0d9dbf None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=6a2326353998441c938abf274b5e5dd4, role_id=2da610f1e24748d597d353508d98c21e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:13.560749 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117f077-36a5-48bb-9fd5-7618ee0d9dbf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:13.568335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7bd7d-a6cb-4eec-8037-bf689e65494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:13.569040 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7bd7d-a6cb-4eec-8037-bf689e65494d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.569780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7bd7d-a6cb-4eec-8037-bf689e65494d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.570120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7bd7d-a6cb-4eec-8037-bf689e65494d None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.570830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7bd7d-a6cb-4eec-8037-bf689e65494d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:13.571348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7bd7d-a6cb-4eec-8037-bf689e65494d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:13.573493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7bd7d-a6cb-4eec-8037-bf689e65494d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:13.589413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 310/629] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:13.589413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7bd7d-a6cb-4eec-8037-bf689e65494d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:13.633762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 320/630] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:06:13 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/6a2326353998441c938abf274b5e5dd4/roles/2da610f1e24748d597d353508d98c21e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:06:13.635707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117f077-36a5-48bb-9fd5-7618ee0d9dbf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:13.692736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:13.701931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7bd7d-a6cb-4eec-8037-bf689e65494d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:13.742164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9c891-320d-4bcc-a6e9-d1d87e73c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:13.742813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c891-320d-4bcc-a6e9-d1d87e73c2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.744173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c891-320d-4bcc-a6e9-d1d87e73c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.744492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c891-320d-4bcc-a6e9-d1d87e73c2b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.758558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9c891-320d-4bcc-a6e9-d1d87e73c2b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-88f9c891-320d-4bcc-a6e9-d1d87e73c2b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:13.765174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:13.766297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:13.767136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 311/631] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:13.768313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9c891-320d-4bcc-a6e9-d1d87e73c2b4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:13.832359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117f077-36a5-48bb-9fd5-7618ee0d9dbf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:13.870343 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f1137-f1e8-414f-8657-9fecffb5eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:13.871348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1137-f1e8-414f-8657-9fecffb5eb8c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.871902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1137-f1e8-414f-8657-9fecffb5eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.872382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1137-f1e8-414f-8657-9fecffb5eb8c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.881964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f1137-f1e8-414f-8657-9fecffb5eb8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:13.885154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f1137-f1e8-414f-8657-9fecffb5eb8c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:13.896493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9c891-320d-4bcc-a6e9-d1d87e73c2b4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ec6f1137-f1e8-414f-8657-9fecffb5eb8c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:13.906320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:13.907318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 321/632] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:13.908277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f1137-f1e8-414f-8657-9fecffb5eb8c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:13.929256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:13.943118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373701b-e7a4-4053-9e37-0480fba569a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:13.943767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373701b-e7a4-4053-9e37-0480fba569a1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.944108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373701b-e7a4-4053-9e37-0480fba569a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.944703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373701b-e7a4-4053-9e37-0480fba569a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.959783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373701b-e7a4-4053-9e37-0480fba569a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-2373701b-e7a4-4053-9e37-0480fba569a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:13.968875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:13.971135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:13.972546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 312/633] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:13.973640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373701b-e7a4-4053-9e37-0480fba569a1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:13.992649 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.020743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f1137-f1e8-414f-8657-9fecffb5eb8c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.057978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0974b8-a554-4143-9fc0-83e8fc406b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.058968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0974b8-a554-4143-9fc0-83e8fc406b71 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.059847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0974b8-a554-4143-9fc0-83e8fc406b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.060573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0974b8-a554-4143-9fc0-83e8fc406b71 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.061457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0974b8-a554-4143-9fc0-83e8fc406b71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:14.062179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0974b8-a554-4143-9fc0-83e8fc406b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.064496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0974b8-a554-4143-9fc0-83e8fc406b71 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.080644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 322/634] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:14.081726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0974b8-a554-4143-9fc0-83e8fc406b71 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.085611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373701b-e7a4-4053-9e37-0480fba569a1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.125273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7e3f2-e167-414b-bda2-5ab011922118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.126225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7e3f2-e167-414b-bda2-5ab011922118 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.126648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7e3f2-e167-414b-bda2-5ab011922118 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.126945 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7e3f2-e167-414b-bda2-5ab011922118 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.127653 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7e3f2-e167-414b-bda2-5ab011922118 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:14.127961 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7e3f2-e167-414b-bda2-5ab011922118 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.129415 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7e3f2-e167-414b-bda2-5ab011922118 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.153201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 313/635] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 17 16:06:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:14.153201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913245f8-7778-468a-99d8-6bfd5665d79a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.153201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913245f8-7778-468a-99d8-6bfd5665d79a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.153201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913245f8-7778-468a-99d8-6bfd5665d79a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.153201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 314/636] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:14.153201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913245f8-7778-468a-99d8-6bfd5665d79a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.170047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.191014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0974b8-a554-4143-9fc0-83e8fc406b71 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.233203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.234646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78140c-88ec-4d30-8fae-30ac79155ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.235621 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78140c-88ec-4d30-8fae-30ac79155ffd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.235902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78140c-88ec-4d30-8fae-30ac79155ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.236173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78140c-88ec-4d30-8fae-30ac79155ffd None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.236836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78140c-88ec-4d30-8fae-30ac79155ffd None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:14.237136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78140c-88ec-4d30-8fae-30ac79155ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.238542 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78140c-88ec-4d30-8fae-30ac79155ffd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.252173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 323/637] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:14.252173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78140c-88ec-4d30-8fae-30ac79155ffd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.273354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913245f8-7778-468a-99d8-6bfd5665d79a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.308664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a96a-bfea-4d48-b8ba-af1729a7aff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.309685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a96a-bfea-4d48-b8ba-af1729a7aff1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.310027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a96a-bfea-4d48-b8ba-af1729a7aff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.310355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a96a-bfea-4d48-b8ba-af1729a7aff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.321026 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a96a-bfea-4d48-b8ba-af1729a7aff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.323183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a96a-bfea-4d48-b8ba-af1729a7aff1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-fec4a96a-bfea-4d48-b8ba-af1729a7aff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:14.338655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:14.339842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:14.340790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:14.340790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:14.340790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:14.340790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 315/638] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:14.341612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e78e75-bd8f-4627-ae0e-f8f18ea8aac6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.341728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e78e75-bd8f-4627-ae0e-f8f18ea8aac6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.341988 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e78e75-bd8f-4627-ae0e-f8f18ea8aac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.359824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-41e78e75-bd8f-4627-ae0e-f8f18ea8aac6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:14.361088 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-41e78e75-bd8f-4627-ae0e-f8f18ea8aac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:14.363167 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78140c-88ec-4d30-8fae-30ac79155ffd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.398710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250895da-19f8-432b-9ff3-8b351253af4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.399531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250895da-19f8-432b-9ff3-8b351253af4f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.400010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250895da-19f8-432b-9ff3-8b351253af4f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.400292 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250895da-19f8-432b-9ff3-8b351253af4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.412284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.434269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 316/639] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:14.435735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e78e75-bd8f-4627-ae0e-f8f18ea8aac6 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.481682 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250895da-19f8-432b-9ff3-8b351253af4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.483302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250895da-19f8-432b-9ff3-8b351253af4f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.503043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.565279 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e78e75-bd8f-4627-ae0e-f8f18ea8aac6 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.590712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 324/640] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:06:14.591748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250895da-19f8-432b-9ff3-8b351253af4f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.611848 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ce77f-c3df-44db-9f0a-38f8e0b69f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.612476 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce77f-c3df-44db-9f0a-38f8e0b69f8f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.612749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce77f-c3df-44db-9f0a-38f8e0b69f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.613012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce77f-c3df-44db-9f0a-38f8e0b69f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.624973 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ce77f-c3df-44db-9f0a-38f8e0b69f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.626363 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ce77f-c3df-44db-9f0a-38f8e0b69f8f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-612ce77f-c3df-44db-9f0a-38f8e0b69f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:14.641908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:14.642872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:14.643748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:14.643748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:14.643748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:14.647718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 317/641] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:14.648474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.649409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ce77f-c3df-44db-9f0a-38f8e0b69f8f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.723765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250895da-19f8-432b-9ff3-8b351253af4f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.760250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451241e-b7de-4522-b13b-341f7cde944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.760923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451241e-b7de-4522-b13b-341f7cde944c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.761298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451241e-b7de-4522-b13b-341f7cde944c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.761661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451241e-b7de-4522-b13b-341f7cde944c None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.762391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451241e-b7de-4522-b13b-341f7cde944c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:14.762750 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451241e-b7de-4522-b13b-341f7cde944c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.763855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ce77f-c3df-44db-9f0a-38f8e0b69f8f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.764260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451241e-b7de-4522-b13b-341f7cde944c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.766526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.777196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 325/642] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:14.782599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451241e-b7de-4522-b13b-341f7cde944c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.801425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19f0d-dc53-4225-bf75-cf02d6956cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.802183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19f0d-dc53-4225-bf75-cf02d6956cdf None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.802530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19f0d-dc53-4225-bf75-cf02d6956cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.802872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19f0d-dc53-4225-bf75-cf02d6956cdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.814436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae19f0d-dc53-4225-bf75-cf02d6956cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.815888 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae19f0d-dc53-4225-bf75-cf02d6956cdf None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-9ae19f0d-dc53-4225-bf75-cf02d6956cdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:14.831343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:14.832639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:14.833827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:14.833827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:14.833827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:14.837666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 318/643] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:14.838656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19f0d-dc53-4225-bf75-cf02d6956cdf None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.902498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451241e-b7de-4522-b13b-341f7cde944c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.904195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.940187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1bb3d-db4f-4f36-8641-c6408cf48334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.941121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1bb3d-db4f-4f36-8641-c6408cf48334 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.941600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1bb3d-db4f-4f36-8641-c6408cf48334 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.941877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1bb3d-db4f-4f36-8641-c6408cf48334 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.942533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1bb3d-db4f-4f36-8641-c6408cf48334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:14.942834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1bb3d-db4f-4f36-8641-c6408cf48334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.944254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1bb3d-db4f-4f36-8641-c6408cf48334 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.954924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19f0d-dc53-4225-bf75-cf02d6956cdf None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.960281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 326/644] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:14.961148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1bb3d-db4f-4f36-8641-c6408cf48334 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.992655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f785b-e9db-4195-b395-6300c3a376a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.993855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f785b-e9db-4195-b395-6300c3a376a3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.994213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f785b-e9db-4195-b395-6300c3a376a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.994494 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f785b-e9db-4195-b395-6300c3a376a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.006201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f785b-e9db-4195-b395-6300c3a376a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-969f785b-e9db-4195-b395-6300c3a376a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:15.011703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:15.012625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 319/645] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:15.013580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f785b-e9db-4195-b395-6300c3a376a3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.033549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.075093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1bb3d-db4f-4f36-8641-c6408cf48334 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.110720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4247fb-4830-4690-934e-e86480a09e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.111354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4247fb-4830-4690-934e-e86480a09e3a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.111638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4247fb-4830-4690-934e-e86480a09e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.111913 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4247fb-4830-4690-934e-e86480a09e3a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.117831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f785b-e9db-4195-b395-6300c3a376a3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.119760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4247fb-4830-4690-934e-e86480a09e3a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.121226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4247fb-4830-4690-934e-e86480a09e3a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-1f4247fb-4830-4690-934e-e86480a09e3a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:15.132276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:15.133411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:15.134781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:15.134781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:15.134781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:15.134781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:15.134781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:15.134781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:15.134781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:15.134781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:15.134781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:06:15.134781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:15.138308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 327/646] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:15.139024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4247fb-4830-4690-934e-e86480a09e3a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.158646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36114939-fde0-4367-b878-ea835713ab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.159263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36114939-fde0-4367-b878-ea835713ab05 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.159545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36114939-fde0-4367-b878-ea835713ab05 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.159818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36114939-fde0-4367-b878-ea835713ab05 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.160458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36114939-fde0-4367-b878-ea835713ab05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:15.160758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36114939-fde0-4367-b878-ea835713ab05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.162173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36114939-fde0-4367-b878-ea835713ab05 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.165810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.178938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 320/647] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:15.178938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36114939-fde0-4367-b878-ea835713ab05 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.251952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4247fb-4830-4690-934e-e86480a09e3a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.257231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.280368 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36114939-fde0-4367-b878-ea835713ab05 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.297176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363e6b4-983f-4624-98e4-67d894890e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.298078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363e6b4-983f-4624-98e4-67d894890e94 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.298356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363e6b4-983f-4624-98e4-67d894890e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.298640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363e6b4-983f-4624-98e4-67d894890e94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.305892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363e6b4-983f-4624-98e4-67d894890e94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.307387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363e6b4-983f-4624-98e4-67d894890e94 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b363e6b4-983f-4624-98e4-67d894890e94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:15.318804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:15.320007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:15.320931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:15.320931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:15.320931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:15.320931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:15.320931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:15.320931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:15.320931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:15.320931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:15.320931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:15.320931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:15.322066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a0a3-334a-4b59-b0e7-45a9ab4d87ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.322066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a0a3-334a-4b59-b0e7-45a9ab4d87ef None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.322066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a0a3-334a-4b59-b0e7-45a9ab4d87ef None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.322066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a0a3-334a-4b59-b0e7-45a9ab4d87ef None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.322442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a0a3-334a-4b59-b0e7-45a9ab4d87ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:15.322442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a0a3-334a-4b59-b0e7-45a9ab4d87ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.323377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a0a3-334a-4b59-b0e7-45a9ab4d87ef None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.325607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 328/648] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:15.326257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363e6b4-983f-4624-98e4-67d894890e94 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.333207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 321/649] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:15.334094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a0a3-334a-4b59-b0e7-45a9ab4d87ef None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.417165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.435188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363e6b4-983f-4624-98e4-67d894890e94 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.441134 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a0a3-334a-4b59-b0e7-45a9ab4d87ef None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.471573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c5e97-2e0b-4fad-b381-9e4a08c7f0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.472185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c5e97-2e0b-4fad-b381-9e4a08c7f0de None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.472466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c5e97-2e0b-4fad-b381-9e4a08c7f0de None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.472737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c5e97-2e0b-4fad-b381-9e4a08c7f0de None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.473492 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c5e97-2e0b-4fad-b381-9e4a08c7f0de None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:15.473795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c5e97-2e0b-4fad-b381-9e4a08c7f0de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.475262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c5e97-2e0b-4fad-b381-9e4a08c7f0de None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.482635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aa1f6-7440-4bfa-a173-deb8f2e5a937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.483631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aa1f6-7440-4bfa-a173-deb8f2e5a937 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.484844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aa1f6-7440-4bfa-a173-deb8f2e5a937 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.485331 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aa1f6-7440-4bfa-a173-deb8f2e5a937 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.492156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 329/650] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:15.492969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c5e97-2e0b-4fad-b381-9e4a08c7f0de None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.497818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20aa1f6-7440-4bfa-a173-deb8f2e5a937 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.499268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20aa1f6-7440-4bfa-a173-deb8f2e5a937 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.502101 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-c20aa1f6-7440-4bfa-a173-deb8f2e5a937 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:15.513795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:15.520272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:15.521177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:15.521177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:15.521177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:15.521177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:15.521177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:15.521177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:15.521177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:15.521177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:15.521177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 322/651] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:15.521177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aa1f6-7440-4bfa-a173-deb8f2e5a937 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.609715 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c5e97-2e0b-4fad-b381-9e4a08c7f0de None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.623024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aa1f6-7440-4bfa-a173-deb8f2e5a937 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.644404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2f00f-b519-46a7-a868-41704f8d13b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.645007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2f00f-b519-46a7-a868-41704f8d13b4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.645287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2f00f-b519-46a7-a868-41704f8d13b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.645584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2f00f-b519-46a7-a868-41704f8d13b4 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.646300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2f00f-b519-46a7-a868-41704f8d13b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:15.646600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2f00f-b519-46a7-a868-41704f8d13b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.648016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2f00f-b519-46a7-a868-41704f8d13b4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.658587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.664790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3b3fc-fe10-4c7d-8090-f8544148d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.665473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3b3fc-fe10-4c7d-8090-f8544148d703 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.665802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3b3fc-fe10-4c7d-8090-f8544148d703 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.666001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3b3fc-fe10-4c7d-8090-f8544148d703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.668482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 330/652] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:15.669930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2f00f-b519-46a7-a868-41704f8d13b4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.677411 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3b3fc-fe10-4c7d-8090-f8544148d703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.679009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3b3fc-fe10-4c7d-8090-f8544148d703 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-80f3b3fc-fe10-4c7d-8090-f8544148d703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:15.693483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:15.694807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:15.695705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:15.695705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:15.695705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:15.700120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 323/653] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:15.700982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3b3fc-fe10-4c7d-8090-f8544148d703 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.750742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.775586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2f00f-b519-46a7-a868-41704f8d13b4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.800550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3b3fc-fe10-4c7d-8090-f8544148d703 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.809644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e959a0-24f9-4fd4-9465-2362c644fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.810251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e959a0-24f9-4fd4-9465-2362c644fd21 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.810531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e959a0-24f9-4fd4-9465-2362c644fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.810803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e959a0-24f9-4fd4-9465-2362c644fd21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.834679 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec494a-a140-4e96-9216-8858ad8b3958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.835278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec494a-a140-4e96-9216-8858ad8b3958 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.835548 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec494a-a140-4e96-9216-8858ad8b3958 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.835812 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec494a-a140-4e96-9216-8858ad8b3958 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.836484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec494a-a140-4e96-9216-8858ad8b3958 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:15.836838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec494a-a140-4e96-9216-8858ad8b3958 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.838282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec494a-a140-4e96-9216-8858ad8b3958 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.849976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 324/654] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:15.850926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec494a-a140-4e96-9216-8858ad8b3958 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.878958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.882729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e959a0-24f9-4fd4-9465-2362c644fd21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.885055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e959a0-24f9-4fd4-9465-2362c644fd21 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.957231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec494a-a140-4e96-9216-8858ad8b3958 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.968487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.984428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 331/655] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:06:15.985773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b10af-bb16-4509-93fc-1dd561ffb99e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.986058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b10af-bb16-4509-93fc-1dd561ffb99e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.986330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b10af-bb16-4509-93fc-1dd561ffb99e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.987634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 332/656] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:15.988371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b10af-bb16-4509-93fc-1dd561ffb99e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.997116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8f894-7704-42bd-93d0-8692c8149242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.997759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f894-7704-42bd-93d0-8692c8149242 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.998039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f894-7704-42bd-93d0-8692c8149242 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.998311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8f894-7704-42bd-93d0-8692c8149242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:16.067179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8f894-7704-42bd-93d0-8692c8149242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:16.068645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8f894-7704-42bd-93d0-8692c8149242 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:16.083731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:16.088566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b10af-bb16-4509-93fc-1dd561ffb99e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:16.122931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74fd0c-c09a-4491-8bed-9c838ffcf9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:16.123531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74fd0c-c09a-4491-8bed-9c838ffcf9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:16.123806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74fd0c-c09a-4491-8bed-9c838ffcf9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:16.124077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74fd0c-c09a-4491-8bed-9c838ffcf9e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:16.124707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74fd0c-c09a-4491-8bed-9c838ffcf9e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:16.125003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74fd0c-c09a-4491-8bed-9c838ffcf9e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:16.126413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74fd0c-c09a-4491-8bed-9c838ffcf9e1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:16.137828 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 333/657] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:16.138368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74fd0c-c09a-4491-8bed-9c838ffcf9e1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:16.168675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 325/658] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:06:16.169617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8f894-7704-42bd-93d0-8692c8149242 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:16.181278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:16.236469 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74fd0c-c09a-4491-8bed-9c838ffcf9e1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:16.268539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8f894-7704-42bd-93d0-8692c8149242 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:16.268932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2bde3-2b65-44f2-8187-92ed0f416390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:16.269562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2bde3-2b65-44f2-8187-92ed0f416390 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:16.269869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2bde3-2b65-44f2-8187-92ed0f416390 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:16.270114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2bde3-2b65-44f2-8187-92ed0f416390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:16.270828 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2bde3-2b65-44f2-8187-92ed0f416390 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=e9b8a5b38ac046ed8e8b98f0ecefb07f) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:16.271130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2bde3-2b65-44f2-8187-92ed0f416390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:16.272560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2bde3-2b65-44f2-8187-92ed0f416390 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:16.278169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 334/659] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:16 2022] GET /identity/v3/role_assignments?user.id=e9b8a5b38ac046ed8e8b98f0ecefb07f&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:16.279285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93b70-f908-462f-9087-87bfb1fbc58f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:16.279564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93b70-f908-462f-9087-87bfb1fbc58f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:16.279835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93b70-f908-462f-9087-87bfb1fbc58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:16.302232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-91b93b70-f908-462f-9087-87bfb1fbc58f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:16.303570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-91b93b70-f908-462f-9087-87bfb1fbc58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:16.310115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2b68c-e4c1-404c-8c35-dada5eea3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:16.310860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2b68c-e4c1-404c-8c35-dada5eea3b2f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:16.311200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2b68c-e4c1-404c-8c35-dada5eea3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:16.311529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2b68c-e4c1-404c-8c35-dada5eea3b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:16.323518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2b68c-e4c1-404c-8c35-dada5eea3b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:16.323738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:16.325024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2b68c-e4c1-404c-8c35-dada5eea3b2f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-5cf2b68c-e4c1-404c-8c35-dada5eea3b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:16.341688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:16.342866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:16.343924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:16.343924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:16.343924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:16.345401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 326/660] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:16.346405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2b68c-e4c1-404c-8c35-dada5eea3b2f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:16.381332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 335/661] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:16.386354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b93b70-f908-462f-9087-87bfb1fbc58f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:16.422256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:16.469150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2b68c-e4c1-404c-8c35-dada5eea3b2f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:16.510968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e3b7f-f738-46f4-be49-56be2c4edb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:16.511909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e3b7f-f738-46f4-be49-56be2c4edb82 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:16.512599 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e3b7f-f738-46f4-be49-56be2c4edb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:16.513107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e3b7f-f738-46f4-be49-56be2c4edb82 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:16.519249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b93b70-f908-462f-9087-87bfb1fbc58f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:16.523106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e3b7f-f738-46f4-be49-56be2c4edb82 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:16.525471 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e3b7f-f738-46f4-be49-56be2c4edb82 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-e66e3b7f-f738-46f4-be49-56be2c4edb82 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:16.539673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:16.541539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 327/662] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:16.542700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e3b7f-f738-46f4-be49-56be2c4edb82 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:16.565565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69875715-6b4e-4af6-8c82-a7bd3126d880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:16.566337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875715-6b4e-4af6-8c82-a7bd3126d880 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:16.566714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875715-6b4e-4af6-8c82-a7bd3126d880 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:16.567084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875715-6b4e-4af6-8c82-a7bd3126d880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:16.577945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69875715-6b4e-4af6-8c82-a7bd3126d880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:16.579530 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69875715-6b4e-4af6-8c82-a7bd3126d880 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-69875715-6b4e-4af6-8c82-a7bd3126d880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:16.597350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:16.598589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:16.599657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:16.599657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:16.599657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:16.599657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 336/663] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:16.599657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69875715-6b4e-4af6-8c82-a7bd3126d880 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:16.607813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:16.667959 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e3b7f-f738-46f4-be49-56be2c4edb82 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:16.692037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:16.704376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e68527-2e2a-44f9-8b8f-26ff7f81cd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:16.704983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e68527-2e2a-44f9-8b8f-26ff7f81cd9b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:16.705254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e68527-2e2a-44f9-8b8f-26ff7f81cd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:16.705627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e68527-2e2a-44f9-8b8f-26ff7f81cd9b None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:16.706311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e68527-2e2a-44f9-8b8f-26ff7f81cd9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:16.706629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e68527-2e2a-44f9-8b8f-26ff7f81cd9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:16.708003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e68527-2e2a-44f9-8b8f-26ff7f81cd9b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:16.713403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69875715-6b4e-4af6-8c82-a7bd3126d880 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:16.726357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 328/664] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:16.726357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e68527-2e2a-44f9-8b8f-26ff7f81cd9b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:16.754737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d359-e35e-4708-bf3c-6eb5c957f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:16.755442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d359-e35e-4708-bf3c-6eb5c957f666 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:16.755824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d359-e35e-4708-bf3c-6eb5c957f666 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:16.756195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691d359-e35e-4708-bf3c-6eb5c957f666 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:16.757028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691d359-e35e-4708-bf3c-6eb5c957f666 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:16.757465 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691d359-e35e-4708-bf3c-6eb5c957f666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:16.758999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691d359-e35e-4708-bf3c-6eb5c957f666 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:16.778532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 337/665] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 17 16:06:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:16.783604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d359-e35e-4708-bf3c-6eb5c957f666 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:16.833157 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e68527-2e2a-44f9-8b8f-26ff7f81cd9b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:16.854336 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:16.871230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d58d7-26dd-46a1-86e7-5f29e80dde9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:16.871853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d58d7-26dd-46a1-86e7-5f29e80dde9a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:16.872196 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d58d7-26dd-46a1-86e7-5f29e80dde9a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:16.872394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d58d7-26dd-46a1-86e7-5f29e80dde9a None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:16.873396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d58d7-26dd-46a1-86e7-5f29e80dde9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:16.873396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d58d7-26dd-46a1-86e7-5f29e80dde9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:16.874729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d58d7-26dd-46a1-86e7-5f29e80dde9a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:16.892067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 329/666] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:16.892729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d58d7-26dd-46a1-86e7-5f29e80dde9a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:16.901013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691d359-e35e-4708-bf3c-6eb5c957f666 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:16.937837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886ec3a-24b1-4fc8-b9ea-f84dc65dfba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:16.938707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886ec3a-24b1-4fc8-b9ea-f84dc65dfba3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:16.938983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886ec3a-24b1-4fc8-b9ea-f84dc65dfba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:16.939248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886ec3a-24b1-4fc8-b9ea-f84dc65dfba3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:16.941720 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:16.950845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886ec3a-24b1-4fc8-b9ea-f84dc65dfba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-1886ec3a-24b1-4fc8-b9ea-f84dc65dfba3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:16.956109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:16.957244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:16.958335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:16.960169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 338/667] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:16.960778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886ec3a-24b1-4fc8-b9ea-f84dc65dfba3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:17.011530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d58d7-26dd-46a1-86e7-5f29e80dde9a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:17.049129 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac156af-21c3-4657-bc03-9cb2fac45b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:17.049798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac156af-21c3-4657-bc03-9cb2fac45b47 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.050136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac156af-21c3-4657-bc03-9cb2fac45b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.050413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac156af-21c3-4657-bc03-9cb2fac45b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.057902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac156af-21c3-4657-bc03-9cb2fac45b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:17.059353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac156af-21c3-4657-bc03-9cb2fac45b47 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:17.068759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886ec3a-24b1-4fc8-b9ea-f84dc65dfba3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-1ac156af-21c3-4657-bc03-9cb2fac45b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:17.071790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:17.072987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:17.074532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:17.074532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:17.074532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:17.074532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:17.074532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:17.074532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:17.074532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:17.074532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:17.074532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 330/668] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:17.074532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac156af-21c3-4657-bc03-9cb2fac45b47 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:17.099327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:17.111297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd8871-9a2e-453f-a7b0-6cbc9babe9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:17.111905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd8871-9a2e-453f-a7b0-6cbc9babe9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.116556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd8871-9a2e-453f-a7b0-6cbc9babe9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.116556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd8871-9a2e-453f-a7b0-6cbc9babe9e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.181950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac156af-21c3-4657-bc03-9cb2fac45b47 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:17.183485 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:17.187470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd8871-9a2e-453f-a7b0-6cbc9babe9e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:17.188931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd8871-9a2e-453f-a7b0-6cbc9babe9e4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:17.218802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc16a94-e2a2-422d-a37b-dcad6643a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:17.219530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc16a94-e2a2-422d-a37b-dcad6643a345 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.219933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc16a94-e2a2-422d-a37b-dcad6643a345 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.220270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc16a94-e2a2-422d-a37b-dcad6643a345 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.227147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc16a94-e2a2-422d-a37b-dcad6643a345 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:17.228675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc16a94-e2a2-422d-a37b-dcad6643a345 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-8cc16a94-e2a2-422d-a37b-dcad6643a345 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:17.239670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:17.240725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:17.241901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:17.241901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:17.241901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:17.241901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:17.241901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:17.241901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:17.241901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:17.241901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:17.248876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 331/669] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:17.248876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc16a94-e2a2-422d-a37b-dcad6643a345 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:17.301213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 339/670] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:06:17.302290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd8871-9a2e-453f-a7b0-6cbc9babe9e4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:17.328813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:17.357332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc16a94-e2a2-422d-a37b-dcad6643a345 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:17.396781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87700e49-f191-4b95-b58e-9e31f6e5a88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:17.397586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87700e49-f191-4b95-b58e-9e31f6e5a88d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.397705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87700e49-f191-4b95-b58e-9e31f6e5a88d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.397964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87700e49-f191-4b95-b58e-9e31f6e5a88d None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.398623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87700e49-f191-4b95-b58e-9e31f6e5a88d None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:17.398921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87700e49-f191-4b95-b58e-9e31f6e5a88d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:17.400471 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87700e49-f191-4b95-b58e-9e31f6e5a88d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:17.409677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 332/671] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:17.410492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87700e49-f191-4b95-b58e-9e31f6e5a88d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:17.418683 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd8871-9a2e-453f-a7b0-6cbc9babe9e4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:17.438270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:17.455681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552288-ffca-4987-b085-b2e0ac94a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:17.456422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552288-ffca-4987-b085-b2e0ac94a811 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.456699 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552288-ffca-4987-b085-b2e0ac94a811 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.456969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552288-ffca-4987-b085-b2e0ac94a811 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.457684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8552288-ffca-4987-b085-b2e0ac94a811 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:17.457986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8552288-ffca-4987-b085-b2e0ac94a811 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:17.459420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8552288-ffca-4987-b085-b2e0ac94a811 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:17.471364 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 340/672] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:17.472093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552288-ffca-4987-b085-b2e0ac94a811 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:17.531912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87700e49-f191-4b95-b58e-9e31f6e5a88d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:17.559659 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:17.571702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deac2c3-c8b1-468d-bfa6-caebb2596785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:17.572484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deac2c3-c8b1-468d-bfa6-caebb2596785 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.573863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deac2c3-c8b1-468d-bfa6-caebb2596785 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.573863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deac2c3-c8b1-468d-bfa6-caebb2596785 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.574041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deac2c3-c8b1-468d-bfa6-caebb2596785 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:17.574424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deac2c3-c8b1-468d-bfa6-caebb2596785 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:17.575920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deac2c3-c8b1-468d-bfa6-caebb2596785 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:17.578667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552288-ffca-4987-b085-b2e0ac94a811 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:17.593326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 333/673] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:17.593326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deac2c3-c8b1-468d-bfa6-caebb2596785 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:17.619869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5ce8c-89e9-4ed7-9537-f4bdd46c3b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:17.620580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5ce8c-89e9-4ed7-9537-f4bdd46c3b43 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.620931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5ce8c-89e9-4ed7-9537-f4bdd46c3b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.621398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5ce8c-89e9-4ed7-9537-f4bdd46c3b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.632181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5ce8c-89e9-4ed7-9537-f4bdd46c3b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:17.633878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5ce8c-89e9-4ed7-9537-f4bdd46c3b43 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5ad5ce8c-89e9-4ed7-9537-f4bdd46c3b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:17.649538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:17.650663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:17.651781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:17.651781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:17.651781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:17.655264 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 341/674] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:17.656095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5ce8c-89e9-4ed7-9537-f4bdd46c3b43 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:17.681903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:17.698761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deac2c3-c8b1-468d-bfa6-caebb2596785 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:17.734630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7139d15-09c8-4e94-9238-8ab42e6113d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:17.735292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7139d15-09c8-4e94-9238-8ab42e6113d4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.735571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7139d15-09c8-4e94-9238-8ab42e6113d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.735839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7139d15-09c8-4e94-9238-8ab42e6113d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.747212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7139d15-09c8-4e94-9238-8ab42e6113d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:17.748698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7139d15-09c8-4e94-9238-8ab42e6113d4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:17.760259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5ce8c-89e9-4ed7-9537-f4bdd46c3b43 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b7139d15-09c8-4e94-9238-8ab42e6113d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:17.765354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:17.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:17.767208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:17.767208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:17.767208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:17.767208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 334/675] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:17.768015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7139d15-09c8-4e94-9238-8ab42e6113d4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:17.801284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f3ec-d46a-4953-b46e-4ed083cfc714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:17.801914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f3ec-d46a-4953-b46e-4ed083cfc714 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.802247 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f3ec-d46a-4953-b46e-4ed083cfc714 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.802524 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f3ec-d46a-4953-b46e-4ed083cfc714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.803234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71f3ec-d46a-4953-b46e-4ed083cfc714 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=4227da1895a94c9c845c4f7adf838144) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:17.803537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71f3ec-d46a-4953-b46e-4ed083cfc714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:17.804950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71f3ec-d46a-4953-b46e-4ed083cfc714 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:17.807510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:17.812275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 342/676] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:17 2022] GET /identity/v3/role_assignments?user.id=4227da1895a94c9c845c4f7adf838144&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:17.813166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f3ec-d46a-4953-b46e-4ed083cfc714 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:17.904221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7139d15-09c8-4e94-9238-8ab42e6113d4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:17.947715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6db496-4508-4685-8a9b-df4249daf3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:17.948630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6db496-4508-4685-8a9b-df4249daf3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.949065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6db496-4508-4685-8a9b-df4249daf3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.949525 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6db496-4508-4685-8a9b-df4249daf3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.950481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6db496-4508-4685-8a9b-df4249daf3c5 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=f99edbaee8504487863c6fa4b551c224) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:17.950938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6db496-4508-4685-8a9b-df4249daf3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:17.952586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6db496-4508-4685-8a9b-df4249daf3c5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:17.956600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:17.960722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 335/677] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:17 2022] GET /identity/v3/role_assignments?user.id=f99edbaee8504487863c6fa4b551c224&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:17.962410 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6db496-4508-4685-8a9b-df4249daf3c5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:17.964663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f3ec-d46a-4953-b46e-4ed083cfc714 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.018781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab9506-9694-4646-b62e-fd9f07c22303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.019496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab9506-9694-4646-b62e-fd9f07c22303 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.019874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab9506-9694-4646-b62e-fd9f07c22303 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.020248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab9506-9694-4646-b62e-fd9f07c22303 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.021020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab9506-9694-4646-b62e-fd9f07c22303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:18.021982 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab9506-9694-4646-b62e-fd9f07c22303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.023008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab9506-9694-4646-b62e-fd9f07c22303 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:18.043049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 343/678] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:18.049668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab9506-9694-4646-b62e-fd9f07c22303 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.104513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6db496-4508-4685-8a9b-df4249daf3c5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.136600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:18.150567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ebf54-bee3-4cf6-b90a-14fb533e66f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.151422 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ebf54-bee3-4cf6-b90a-14fb533e66f4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.151850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ebf54-bee3-4cf6-b90a-14fb533e66f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.152270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ebf54-bee3-4cf6-b90a-14fb533e66f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.153089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ebf54-bee3-4cf6-b90a-14fb533e66f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:18.153586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ebf54-bee3-4cf6-b90a-14fb533e66f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.155124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ebf54-bee3-4cf6-b90a-14fb533e66f4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:18.169563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 336/679] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:18.176079 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ebf54-bee3-4cf6-b90a-14fb533e66f4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.188616 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab9506-9694-4646-b62e-fd9f07c22303 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.228806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab063-5779-4b58-af1d-c55b04311a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.229479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab063-5779-4b58-af1d-c55b04311a95 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.229757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab063-5779-4b58-af1d-c55b04311a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.230031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab063-5779-4b58-af1d-c55b04311a95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.237260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ab063-5779-4b58-af1d-c55b04311a95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.238746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ab063-5779-4b58-af1d-c55b04311a95 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-bd2ab063-5779-4b58-af1d-c55b04311a95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:18.251518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:18.252658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:18.253816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:18.253816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:18.253816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:18.253816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:18.253816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:18.253816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:18.253816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:18.253816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:18.254370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 344/680] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:18.261825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab063-5779-4b58-af1d-c55b04311a95 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.265243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:18.324986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ebf54-bee3-4cf6-b90a-14fb533e66f4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.374365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cf213-9535-470e-a36b-7f69e3316f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.375220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cf213-9535-470e-a36b-7f69e3316f28 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.375854 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cf213-9535-470e-a36b-7f69e3316f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.376230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cf213-9535-470e-a36b-7f69e3316f28 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.380799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab063-5779-4b58-af1d-c55b04311a95 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.390442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cf213-9535-470e-a36b-7f69e3316f28 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.392504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cf213-9535-470e-a36b-7f69e3316f28 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:18.403703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-2b6cf213-9535-470e-a36b-7f69e3316f28 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:18.406953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:18.408078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:18.409311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:18.409311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:18.409311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:18.409311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:18.409311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:18.409311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:18.409311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:18.409311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:18.409311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:18.409311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:18.410799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 337/681] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:18.412320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4669e-2d35-4013-8c6e-c7eb806039d5 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.412320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4669e-2d35-4013-8c6e-c7eb806039d5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.412320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4669e-2d35-4013-8c6e-c7eb806039d5 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.413803 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 338/682] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:18.416514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4669e-2d35-4013-8c6e-c7eb806039d5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.431183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9b08d-4f5d-4f4b-96c9-9b5f93fb371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.432065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b08d-4f5d-4f4b-96c9-9b5f93fb371a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.432506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b08d-4f5d-4f4b-96c9-9b5f93fb371a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.432925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b08d-4f5d-4f4b-96c9-9b5f93fb371a None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.433949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9b08d-4f5d-4f4b-96c9-9b5f93fb371a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:18.434449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9b08d-4f5d-4f4b-96c9-9b5f93fb371a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.436191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9b08d-4f5d-4f4b-96c9-9b5f93fb371a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:18.450149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 345/683] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:18.451868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae28a8e-07b0-4b60-b120-43c6450f1c39 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.452295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae28a8e-07b0-4b60-b120-43c6450f1c39 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.452712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae28a8e-07b0-4b60-b120-43c6450f1c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.476617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dae28a8e-07b0-4b60-b120-43c6450f1c39 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:18.479163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dae28a8e-07b0-4b60-b120-43c6450f1c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:18.533426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4669e-2d35-4013-8c6e-c7eb806039d5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.551358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 346/684] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:18.552528 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae28a8e-07b0-4b60-b120-43c6450f1c39 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.568259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:18.596824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf999c-4ad6-4b09-9b34-ca58cbbf1320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.597966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf999c-4ad6-4b09-9b34-ca58cbbf1320 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.598746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf999c-4ad6-4b09-9b34-ca58cbbf1320 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.599204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf999c-4ad6-4b09-9b34-ca58cbbf1320 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.600094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf999c-4ad6-4b09-9b34-ca58cbbf1320 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:18.600582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf999c-4ad6-4b09-9b34-ca58cbbf1320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.604513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf999c-4ad6-4b09-9b34-ca58cbbf1320 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:18.637159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 339/685] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:18.643028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf999c-4ad6-4b09-9b34-ca58cbbf1320 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.741120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae28a8e-07b0-4b60-b120-43c6450f1c39 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.766872 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:18.803377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf999c-4ad6-4b09-9b34-ca58cbbf1320 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.834084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a09b8-e7a2-4c5e-9df7-0485ce2da530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.835520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a09b8-e7a2-4c5e-9df7-0485ce2da530 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.836097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a09b8-e7a2-4c5e-9df7-0485ce2da530 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.837716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a09b8-e7a2-4c5e-9df7-0485ce2da530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.839019 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a09b8-e7a2-4c5e-9df7-0485ce2da530 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=4ad54a22e6e747d9887c82bb62a923da) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:18.839657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a09b8-e7a2-4c5e-9df7-0485ce2da530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.842113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a09b8-e7a2-4c5e-9df7-0485ce2da530 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:18.849770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d40354-41f2-4433-895f-a6a168306263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.851734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40354-41f2-4433-895f-a6a168306263 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.853221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40354-41f2-4433-895f-a6a168306263 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.854897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40354-41f2-4433-895f-a6a168306263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.858831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 347/686] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/role_assignments?user.id=4ad54a22e6e747d9887c82bb62a923da&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:18.907501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a09b8-e7a2-4c5e-9df7-0485ce2da530 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.921587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:18.949114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d40354-41f2-4433-895f-a6a168306263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.950901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d40354-41f2-4433-895f-a6a168306263 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.102711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 340/687] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:06:19.108982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d40354-41f2-4433-895f-a6a168306263 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:19.111917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a09b8-e7a2-4c5e-9df7-0485ce2da530 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.156226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbafa35-ca83-4ac2-84b0-25e35971b926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.161210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbafa35-ca83-4ac2-84b0-25e35971b926 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.161720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbafa35-ca83-4ac2-84b0-25e35971b926 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.162148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbafa35-ca83-4ac2-84b0-25e35971b926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.175002 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbafa35-ca83-4ac2-84b0-25e35971b926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.176667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbafa35-ca83-4ac2-84b0-25e35971b926 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0cbafa35-ca83-4ac2-84b0-25e35971b926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:19.193842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:19.195282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:19.196908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:19.196908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:19.196908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:19.198679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 348/688] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:19.209159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbafa35-ca83-4ac2-84b0-25e35971b926 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:19.212378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:19.244343 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:19.248507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d40354-41f2-4433-895f-a6a168306263 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.297685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b881d-a14d-4922-a23f-531fed12d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.299193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b881d-a14d-4922-a23f-531fed12d50c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.299685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b881d-a14d-4922-a23f-531fed12d50c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.300509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b881d-a14d-4922-a23f-531fed12d50c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.314134 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b881d-a14d-4922-a23f-531fed12d50c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.315650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b881d-a14d-4922-a23f-531fed12d50c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.331417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbafa35-ca83-4ac2-84b0-25e35971b926 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-8c5b881d-a14d-4922-a23f-531fed12d50c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:19.332879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:19.333836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:19.334742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:19.334742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:19.334742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:19.334742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 341/689] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:19.342333 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b881d-a14d-4922-a23f-531fed12d50c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:19.374273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e50250-96b8-4476-bf6d-c0b709e050f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.374933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50250-96b8-4476-bf6d-c0b709e050f3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.375213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50250-96b8-4476-bf6d-c0b709e050f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.375481 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50250-96b8-4476-bf6d-c0b709e050f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.376133 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e50250-96b8-4476-bf6d-c0b709e050f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:19.376431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e50250-96b8-4476-bf6d-c0b709e050f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.377855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e50250-96b8-4476-bf6d-c0b709e050f3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.392442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 349/690] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:19.399925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e50250-96b8-4476-bf6d-c0b709e050f3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:19.496491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b881d-a14d-4922-a23f-531fed12d50c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.528439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:19.535153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229c67c-c304-40bf-b794-ea043db32c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.542071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229c67c-c304-40bf-b794-ea043db32c7d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.542071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229c67c-c304-40bf-b794-ea043db32c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.542071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229c67c-c304-40bf-b794-ea043db32c7d None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.542071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229c67c-c304-40bf-b794-ea043db32c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:19.542071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229c67c-c304-40bf-b794-ea043db32c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.542071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229c67c-c304-40bf-b794-ea043db32c7d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.561812 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 342/691] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:19.567508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229c67c-c304-40bf-b794-ea043db32c7d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:19.591861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:19.621139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e50250-96b8-4476-bf6d-c0b709e050f3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.694513 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc93dd2-b9e6-4e0c-bed8-7e4f60495cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.695981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc93dd2-b9e6-4e0c-bed8-7e4f60495cdd None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.696761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc93dd2-b9e6-4e0c-bed8-7e4f60495cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.697029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc93dd2-b9e6-4e0c-bed8-7e4f60495cdd None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.697698 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc93dd2-b9e6-4e0c-bed8-7e4f60495cdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.699136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc93dd2-b9e6-4e0c-bed8-7e4f60495cdd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.745591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229c67c-c304-40bf-b794-ea043db32c7d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.782530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349edf0a-9201-4c49-a41a-d5f3de0dfdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.783222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349edf0a-9201-4c49-a41a-d5f3de0dfdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.783498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349edf0a-9201-4c49-a41a-d5f3de0dfdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.783771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349edf0a-9201-4c49-a41a-d5f3de0dfdc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.791568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349edf0a-9201-4c49-a41a-d5f3de0dfdc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.793011 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349edf0a-9201-4c49-a41a-d5f3de0dfdc4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-349edf0a-9201-4c49-a41a-d5f3de0dfdc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:19.804614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:19.805735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:19.807383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:19.807383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:19.807383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:19.807383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:19.807383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:19.807383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:19.807383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:19.807383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:19.807383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 343/692] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:19.811575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349edf0a-9201-4c49-a41a-d5f3de0dfdc4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:19.812928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 350/693] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:06:19 2022] POST /identity/v3/users => generated 254 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:06:19.872128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:19.929805 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349edf0a-9201-4c49-a41a-d5f3de0dfdc4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.969029 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bd51a-63e2-48a9-a5e5-79bc35db791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.969641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bd51a-63e2-48a9-a5e5-79bc35db791e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.969919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bd51a-63e2-48a9-a5e5-79bc35db791e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.970239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bd51a-63e2-48a9-a5e5-79bc35db791e None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.970944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bd51a-63e2-48a9-a5e5-79bc35db791e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:19.971244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bd51a-63e2-48a9-a5e5-79bc35db791e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.972685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bd51a-63e2-48a9-a5e5-79bc35db791e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.987960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 344/694] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:19.994540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc93dd2-b9e6-4e0c-bed8-7e4f60495cdd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:20.108571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc93dd2-b9e6-4e0c-bed8-7e4f60495cdd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:20.144159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd4d7e-4415-4023-97df-3e7c55f3d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:20.144772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4d7e-4415-4023-97df-3e7c55f3d890 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:20.145052 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4d7e-4415-4023-97df-3e7c55f3d890 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:20.145326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4d7e-4415-4023-97df-3e7c55f3d890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:20.146100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd4d7e-4415-4023-97df-3e7c55f3d890 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=6a2326353998441c938abf274b5e5dd4) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:20.146404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd4d7e-4415-4023-97df-3e7c55f3d890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:20.147850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd4d7e-4415-4023-97df-3e7c55f3d890 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:20.155422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 351/695] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:19 2022] GET /identity/v3/role_assignments?user.id=6a2326353998441c938abf274b5e5dd4&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:20.317544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd858e-9fb4-497a-9772-18560916315f None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:20.317738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd858e-9fb4-497a-9772-18560916315f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:20.318000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd858e-9fb4-497a-9772-18560916315f None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:20.319906 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 345/696] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:20.325931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff42f4-8980-487a-8b9c-c06b780dfb17 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:20.326219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff42f4-8980-487a-8b9c-c06b780dfb17 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:20.326499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff42f4-8980-487a-8b9c-c06b780dfb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:20.334017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:20.346088 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-83ff42f4-8980-487a-8b9c-c06b780dfb17 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:20.347348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-83ff42f4-8980-487a-8b9c-c06b780dfb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:20.414764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5025f0-3a19-409a-b26e-2345e8a7cc70 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:20.415444 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5025f0-3a19-409a-b26e-2345e8a7cc70 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:20.415999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5025f0-3a19-409a-b26e-2345e8a7cc70 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:20.417975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 346/697] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:20.423209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 352/698] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:20.424040 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591c7a3-67c1-4115-9187-1c7b21b04a75 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:20.424606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591c7a3-67c1-4115-9187-1c7b21b04a75 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:20.425096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591c7a3-67c1-4115-9187-1c7b21b04a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:20.447885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-0591c7a3-67c1-4115-9187-1c7b21b04a75 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:20.449492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0591c7a3-67c1-4115-9187-1c7b21b04a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:20.521669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 347/699] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:06:20.715887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff42f4-8980-487a-8b9c-c06b780dfb17 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:20.819825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591c7a3-67c1-4115-9187-1c7b21b04a75 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:20.824869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff42f4-8980-487a-8b9c-c06b780dfb17 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:20.869517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47674609-4ffd-4a7f-9bea-e877ff01fd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:20.870171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47674609-4ffd-4a7f-9bea-e877ff01fd52 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:20.870447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47674609-4ffd-4a7f-9bea-e877ff01fd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:20.870716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47674609-4ffd-4a7f-9bea-e877ff01fd52 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:20.871310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47674609-4ffd-4a7f-9bea-e877ff01fd52 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:20.872866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47674609-4ffd-4a7f-9bea-e877ff01fd52 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:20.875156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:20.881685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-47674609-4ffd-4a7f-9bea-e877ff01fd52 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:20.891151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:20.892173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:06:20.892999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:20.897046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 353/700] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 17 16:06:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:20.897919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47674609-4ffd-4a7f-9bea-e877ff01fd52 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:20.998703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591c7a3-67c1-4115-9187-1c7b21b04a75 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:21.060604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b0d5c-71f2-4ac9-b030-a6731e6225bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:21.061254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b0d5c-71f2-4ac9-b030-a6731e6225bd None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:21.061553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b0d5c-71f2-4ac9-b030-a6731e6225bd None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:21.061818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b0d5c-71f2-4ac9-b030-a6731e6225bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:21.077443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47674609-4ffd-4a7f-9bea-e877ff01fd52 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:21.082602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b0d5c-71f2-4ac9-b030-a6731e6225bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-c10b0d5c-71f2-4ac9-b030-a6731e6225bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:21.087962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:21.088886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:21.090389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 348/701] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:21.096376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b0d5c-71f2-4ac9-b030-a6731e6225bd None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:21.142327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa75b50-3882-4bc4-aa16-97882be54ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:21.142947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa75b50-3882-4bc4-aa16-97882be54ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:21.143226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa75b50-3882-4bc4-aa16-97882be54ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:21.143557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa75b50-3882-4bc4-aa16-97882be54ae6 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:21.144246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa75b50-3882-4bc4-aa16-97882be54ae6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:21.144593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa75b50-3882-4bc4-aa16-97882be54ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:21.146014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa75b50-3882-4bc4-aa16-97882be54ae6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:21.151987 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 354/702] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 17 16:06:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:21.158799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa75b50-3882-4bc4-aa16-97882be54ae6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:21.253701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b0d5c-71f2-4ac9-b030-a6731e6225bd None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:21.261758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:21.285149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:21.305702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648eb4c9-6987-4d0c-bd1f-466754f3268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:21.306335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eb4c9-6987-4d0c-bd1f-466754f3268b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:21.306600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eb4c9-6987-4d0c-bd1f-466754f3268b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:21.306869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648eb4c9-6987-4d0c-bd1f-466754f3268b None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:21.307542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648eb4c9-6987-4d0c-bd1f-466754f3268b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:21.307840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648eb4c9-6987-4d0c-bd1f-466754f3268b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:21.309246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648eb4c9-6987-4d0c-bd1f-466754f3268b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:21.330676 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 349/703] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:21.337500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648eb4c9-6987-4d0c-bd1f-466754f3268b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:21.348982 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa75b50-3882-4bc4-aa16-97882be54ae6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:21.394241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf8095-fc09-4646-8d69-280d956017b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:21.395158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8095-fc09-4646-8d69-280d956017b5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:21.395438 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8095-fc09-4646-8d69-280d956017b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:21.395961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8095-fc09-4646-8d69-280d956017b5 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:21.397008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf8095-fc09-4646-8d69-280d956017b5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:21.397478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf8095-fc09-4646-8d69-280d956017b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:21.400466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf8095-fc09-4646-8d69-280d956017b5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:21.408364 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 355/704] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 17 16:06:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:21.409644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390aeea-5bd3-4653-a0d8-4f48329a901b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:21.409931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390aeea-5bd3-4653-a0d8-4f48329a901b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:21.410207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390aeea-5bd3-4653-a0d8-4f48329a901b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:21.411739 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 356/705] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:21.423900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944d48d-4fdd-4344-8e49-76bfc5e4af35 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:21.424179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944d48d-4fdd-4344-8e49-76bfc5e4af35 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:21.424454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944d48d-4fdd-4344-8e49-76bfc5e4af35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:21.463181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5944d48d-4fdd-4344-8e49-76bfc5e4af35 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:21.464630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5944d48d-4fdd-4344-8e49-76bfc5e4af35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:21.492378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648eb4c9-6987-4d0c-bd1f-466754f3268b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:21.564553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd23f5-17f5-4089-84f7-f7e3d267b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:21.565114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd23f5-17f5-4089-84f7-f7e3d267b28a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:21.565405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd23f5-17f5-4089-84f7-f7e3d267b28a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:21.565679 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd23f5-17f5-4089-84f7-f7e3d267b28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:21.578451 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd23f5-17f5-4089-84f7-f7e3d267b28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:21.580175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd23f5-17f5-4089-84f7-f7e3d267b28a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:21.589135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 357/706] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-cdfd23f5-17f5-4089-84f7-f7e3d267b28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:21.596357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:21.598559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:21.599800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:21.599800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:21.599800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:21.599800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 350/707] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:21.603143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944d48d-4fdd-4344-8e49-76bfc5e4af35 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:21.662928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:21.710074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944d48d-4fdd-4344-8e49-76bfc5e4af35 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:21.753016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53828d-ebdc-4013-8e02-16be74b4bce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:21.754046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53828d-ebdc-4013-8e02-16be74b4bce3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:21.754529 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53828d-ebdc-4013-8e02-16be74b4bce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:21.755066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53828d-ebdc-4013-8e02-16be74b4bce3 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:21.755957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53828d-ebdc-4013-8e02-16be74b4bce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:21.756455 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53828d-ebdc-4013-8e02-16be74b4bce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:21.758051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53828d-ebdc-4013-8e02-16be74b4bce3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:21.778856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 358/708] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:21.783903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd23f5-17f5-4089-84f7-f7e3d267b28a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:21.801334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:21.895130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd23f5-17f5-4089-84f7-f7e3d267b28a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:21.931444 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f616530-48c1-4a4a-9fa0-0f616d74f6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:21.932077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f616530-48c1-4a4a-9fa0-0f616d74f6dc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:21.932355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f616530-48c1-4a4a-9fa0-0f616d74f6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:21.932628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f616530-48c1-4a4a-9fa0-0f616d74f6dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:21.940259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f616530-48c1-4a4a-9fa0-0f616d74f6dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:21.941729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f616530-48c1-4a4a-9fa0-0f616d74f6dc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-4f616530-48c1-4a4a-9fa0-0f616d74f6dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:21.955584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:21.956573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:21.957572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:21.957572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:21.957572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:21.957572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:21.957572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:21.957572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:21.957572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:21.957572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:21.957572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:21.957572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:21.957572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 351/709] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 17 16:06:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:21.962546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53828d-ebdc-4013-8e02-16be74b4bce3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:22.006853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f616530-48c1-4a4a-9fa0-0f616d74f6dc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:22.100609 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53828d-ebdc-4013-8e02-16be74b4bce3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:22.121410 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:22.158974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:22.167247 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9738d4b-96b4-4e7b-8a43-0bbba4252236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:22.167866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9738d4b-96b4-4e7b-8a43-0bbba4252236 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.168190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9738d4b-96b4-4e7b-8a43-0bbba4252236 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.168466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9738d4b-96b4-4e7b-8a43-0bbba4252236 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.169255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9738d4b-96b4-4e7b-8a43-0bbba4252236 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:22.169584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9738d4b-96b4-4e7b-8a43-0bbba4252236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:22.171009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9738d4b-96b4-4e7b-8a43-0bbba4252236 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:22.204871 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f616530-48c1-4a4a-9fa0-0f616d74f6dc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:22.208558 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 359/710] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 17 16:06:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:22.214405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9738d4b-96b4-4e7b-8a43-0bbba4252236 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:22.260229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5f641-eeb7-4afc-904f-01cb9af4374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:22.260865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f641-eeb7-4afc-904f-01cb9af4374d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.261141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f641-eeb7-4afc-904f-01cb9af4374d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.264029 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f641-eeb7-4afc-904f-01cb9af4374d None admin] PATH_INFO: `/v3/services/network` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.264644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f641-eeb7-4afc-904f-01cb9af4374d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:22.266143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f641-eeb7-4afc-904f-01cb9af4374d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-dab5f641-eeb7-4afc-904f-01cb9af4374d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:22.280082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:22.281198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:22.282178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 352/711] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:22 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:22.283027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fd2a4-68d0-45b6-a447-d408a0b70648 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.283027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fd2a4-68d0-45b6-a447-d408a0b70648 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.283728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fd2a4-68d0-45b6-a447-d408a0b70648 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.292589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 353/712] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:22.292589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fd2a4-68d0-45b6-a447-d408a0b70648 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:22.343108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9738d4b-96b4-4e7b-8a43-0bbba4252236 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:22.382816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3dbb5-5c2d-4792-88fb-daa7f1f5e470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:22.383557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3dbb5-5c2d-4792-88fb-daa7f1f5e470 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.384001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3dbb5-5c2d-4792-88fb-daa7f1f5e470 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.384278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3dbb5-5c2d-4792-88fb-daa7f1f5e470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.402346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fd2a4-68d0-45b6-a447-d408a0b70648 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:22.430974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:22.440128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603f154-b7cc-47e4-9b0f-4e0f1a4e0afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:22.445828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603f154-b7cc-47e4-9b0f-4e0f1a4e0afe None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.445828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603f154-b7cc-47e4-9b0f-4e0f1a4e0afe None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.445828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603f154-b7cc-47e4-9b0f-4e0f1a4e0afe None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.445828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603f154-b7cc-47e4-9b0f-4e0f1a4e0afe None admin] RBAC: Adding query filter params (name=network) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:22.445828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603f154-b7cc-47e4-9b0f-4e0f1a4e0afe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:22.445828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603f154-b7cc-47e4-9b0f-4e0f1a4e0afe None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:22.453253 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 354/713] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:22.454553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a8823-25e8-49a1-9627-c2348c74826c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.454839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a8823-25e8-49a1-9627-c2348c74826c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.455113 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a8823-25e8-49a1-9627-c2348c74826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.457589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3dbb5-5c2d-4792-88fb-daa7f1f5e470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:22.459133 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3dbb5-5c2d-4792-88fb-daa7f1f5e470 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:22.461895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:22.475697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8a4a8823-25e8-49a1-9627-c2348c74826c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:22.477970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8a4a8823-25e8-49a1-9627-c2348c74826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:22.554151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 355/714] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:22.554965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a8823-25e8-49a1-9627-c2348c74826c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:22.568107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 360/715] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:06:22.575699 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3dbb5-5c2d-4792-88fb-daa7f1f5e470 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:22.690382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a8823-25e8-49a1-9627-c2348c74826c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:22.726390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:22.741005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099ccac-caf5-4855-b3ed-bce3851191a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:22.753185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:22.753311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099ccac-caf5-4855-b3ed-bce3851191a0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.753311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099ccac-caf5-4855-b3ed-bce3851191a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.753311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099ccac-caf5-4855-b3ed-bce3851191a0 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.753311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099ccac-caf5-4855-b3ed-bce3851191a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:22.753311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099ccac-caf5-4855-b3ed-bce3851191a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:22.753311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099ccac-caf5-4855-b3ed-bce3851191a0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:22.753756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 356/716] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:22.772419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3dbb5-5c2d-4792-88fb-daa7f1f5e470 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:22.825310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991edfdd-5321-4f0c-9697-6a09b4aa397b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:22.826388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991edfdd-5321-4f0c-9697-6a09b4aa397b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.826880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991edfdd-5321-4f0c-9697-6a09b4aa397b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.827365 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991edfdd-5321-4f0c-9697-6a09b4aa397b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.833420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099ccac-caf5-4855-b3ed-bce3851191a0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:22.843890 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991edfdd-5321-4f0c-9697-6a09b4aa397b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:22.845851 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991edfdd-5321-4f0c-9697-6a09b4aa397b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-991edfdd-5321-4f0c-9697-6a09b4aa397b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:22.863073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:22.864194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:22.865131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:22.865131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:22.865131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:22.867618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 361/717] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:22.873509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991edfdd-5321-4f0c-9697-6a09b4aa397b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:23.002151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099ccac-caf5-4855-b3ed-bce3851191a0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:23.035628 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991edfdd-5321-4f0c-9697-6a09b4aa397b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:23.050785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bde7df-280d-468e-8034-47109e04ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:23.051915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bde7df-280d-468e-8034-47109e04ecab None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:23.052455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bde7df-280d-468e-8034-47109e04ecab None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:23.052728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bde7df-280d-468e-8034-47109e04ecab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:23.065305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:23.067254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bde7df-280d-468e-8034-47109e04ecab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:23.075534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92284f75-7119-4956-a541-1b603e229429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f3bde7df-280d-468e-8034-47109e04ecab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:23.075741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:23.076842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:23.086993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 357/718] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:23.088225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92284f75-7119-4956-a541-1b603e229429 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:23.088225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92284f75-7119-4956-a541-1b603e229429 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:23.088225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92284f75-7119-4956-a541-1b603e229429 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:23.088541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a010-4bef-43f0-8cf0-c734b114367c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:23.088541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a010-4bef-43f0-8cf0-c734b114367c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:23.088766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92284f75-7119-4956-a541-1b603e229429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:23.088882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a010-4bef-43f0-8cf0-c734b114367c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:23.089025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92284f75-7119-4956-a541-1b603e229429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:23.089025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92284f75-7119-4956-a541-1b603e229429 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:23.089227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 358/719] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:23.089227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80a010-4bef-43f0-8cf0-c734b114367c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:23.110078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 362/720] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:23.111789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b512cf-83c6-4d6f-85f0-dec3c9f4eed6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:23.112077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b512cf-83c6-4d6f-85f0-dec3c9f4eed6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:23.112354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b512cf-83c6-4d6f-85f0-dec3c9f4eed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:23.136529 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-69b512cf-83c6-4d6f-85f0-dec3c9f4eed6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:23.137781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-69b512cf-83c6-4d6f-85f0-dec3c9f4eed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:23.164445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:23.222788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80a010-4bef-43f0-8cf0-c734b114367c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:23.229648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 363/721] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:23.230599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b512cf-83c6-4d6f-85f0-dec3c9f4eed6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:23.274301 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ffe82-45e3-4c5c-8c35-ebde077656e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:23.275270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ffe82-45e3-4c5c-8c35-ebde077656e6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:23.275752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ffe82-45e3-4c5c-8c35-ebde077656e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:23.276223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ffe82-45e3-4c5c-8c35-ebde077656e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:23.277098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ffe82-45e3-4c5c-8c35-ebde077656e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:23.280868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ffe82-45e3-4c5c-8c35-ebde077656e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:23.282552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ffe82-45e3-4c5c-8c35-ebde077656e6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:23.306189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 359/722] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:23.307407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ffe82-45e3-4c5c-8c35-ebde077656e6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:23.371743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b512cf-83c6-4d6f-85f0-dec3c9f4eed6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:23.401854 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:23.420731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ffe82-45e3-4c5c-8c35-ebde077656e6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:23.425948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397924dd-c5f7-4331-b88f-590eb41fbb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:23.426591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397924dd-c5f7-4331-b88f-590eb41fbb04 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:23.426874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397924dd-c5f7-4331-b88f-590eb41fbb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:23.427136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397924dd-c5f7-4331-b88f-590eb41fbb04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:23.440202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397924dd-c5f7-4331-b88f-590eb41fbb04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:23.441599 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:23.441713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397924dd-c5f7-4331-b88f-590eb41fbb04 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:23.460933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdadc0-4bce-4cac-9524-d26cbe770e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-397924dd-c5f7-4331-b88f-590eb41fbb04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:23.461164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:23.462221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:23.463109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:23.463109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:23.463109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:23.463109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:23.463109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:23.463109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:23.463109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:23.463109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:23.464710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdadc0-4bce-4cac-9524-d26cbe770e67 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:23.465200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdadc0-4bce-4cac-9524-d26cbe770e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:23.465694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdadc0-4bce-4cac-9524-d26cbe770e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:23.466612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 364/723] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:23.470423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397924dd-c5f7-4331-b88f-590eb41fbb04 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:23.478573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdadc0-4bce-4cac-9524-d26cbe770e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:23.480328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdadc0-4bce-4cac-9524-d26cbe770e67 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f3bdadc0-4bce-4cac-9524-d26cbe770e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:23.504946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:23.505952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:23.506840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:23.506840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:23.506840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:23.514855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 360/724] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:23.521647 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdadc0-4bce-4cac-9524-d26cbe770e67 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:23.632973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397924dd-c5f7-4331-b88f-590eb41fbb04 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:23.660249 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdadc0-4bce-4cac-9524-d26cbe770e67 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:23.667703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28ad0-d54f-484a-a651-9ac0b4e79a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:23.668310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28ad0-d54f-484a-a651-9ac0b4e79a4b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:23.668580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28ad0-d54f-484a-a651-9ac0b4e79a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:23.668844 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28ad0-d54f-484a-a651-9ac0b4e79a4b None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:23.669557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d28ad0-d54f-484a-a651-9ac0b4e79a4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:23.669856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d28ad0-d54f-484a-a651-9ac0b4e79a4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:23.671298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d28ad0-d54f-484a-a651-9ac0b4e79a4b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:23.692768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 365/725] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:23.693668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28ad0-d54f-484a-a651-9ac0b4e79a4b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:23.698448 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c13676-101c-45e5-9ac0-eae851082c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:23.699063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13676-101c-45e5-9ac0-eae851082c2d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:23.699344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13676-101c-45e5-9ac0-eae851082c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:23.699617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13676-101c-45e5-9ac0-eae851082c2d None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:23.700265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c13676-101c-45e5-9ac0-eae851082c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:23.700566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c13676-101c-45e5-9ac0-eae851082c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:23.701973 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c13676-101c-45e5-9ac0-eae851082c2d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:23.715743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 361/726] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:23.716584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c13676-101c-45e5-9ac0-eae851082c2d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:23.729830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:23.750858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:23.796834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28ad0-d54f-484a-a651-9ac0b4e79a4b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:23.831045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c13676-101c-45e5-9ac0-eae851082c2d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:23.831427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d39af-0e66-4815-a994-e0ceadf844de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:23.832060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d39af-0e66-4815-a994-e0ceadf844de None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:23.832334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d39af-0e66-4815-a994-e0ceadf844de None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:23.832606 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d39af-0e66-4815-a994-e0ceadf844de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:23.844257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d39af-0e66-4815-a994-e0ceadf844de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-594d39af-0e66-4815-a994-e0ceadf844de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:23.849229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:23.850393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 366/727] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:23.851441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d39af-0e66-4815-a994-e0ceadf844de None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:23.878712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e16ef3-b338-4b27-9f03-4ded0952b6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:23.879600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16ef3-b338-4b27-9f03-4ded0952b6aa None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:23.880036 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16ef3-b338-4b27-9f03-4ded0952b6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:23.880556 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16ef3-b338-4b27-9f03-4ded0952b6aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:23.887670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e16ef3-b338-4b27-9f03-4ded0952b6aa None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=f99edbaee8504487863c6fa4b551c224) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:23.888199 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e16ef3-b338-4b27-9f03-4ded0952b6aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:23.889699 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e16ef3-b338-4b27-9f03-4ded0952b6aa None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:23.895671 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 362/728] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:23 2022] GET /identity/v3/role_assignments?user.id=f99edbaee8504487863c6fa4b551c224&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=28beda93f70d4c549352145ddee01aac => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:23.899943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e16ef3-b338-4b27-9f03-4ded0952b6aa None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:23.958827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:23.966108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d39af-0e66-4815-a994-e0ceadf844de None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:24.003716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53890d95-82cf-4346-9b81-cc4620d647d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:24.004609 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890d95-82cf-4346-9b81-cc4620d647d2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:24.005033 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890d95-82cf-4346-9b81-cc4620d647d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:24.005500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53890d95-82cf-4346-9b81-cc4620d647d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:24.014536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53890d95-82cf-4346-9b81-cc4620d647d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:24.014919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:24.017023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53890d95-82cf-4346-9b81-cc4620d647d2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:24.026047 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e16ef3-b338-4b27-9f03-4ded0952b6aa None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-53890d95-82cf-4346-9b81-cc4620d647d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:24.030916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:24.031969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:24.032959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:24.032959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:24.032959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:24.032959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:24.032959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:24.032959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:24.032959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:24.032959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:24.032959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:24.032959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:24.036758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 367/729] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 17 16:06:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:24.038472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d391436-2b15-4b68-9ca5-3b9b297df501 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:24.038784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d391436-2b15-4b68-9ca5-3b9b297df501 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:24.045477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d391436-2b15-4b68-9ca5-3b9b297df501 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:24.045477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 368/730] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:24.045477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d391436-2b15-4b68-9ca5-3b9b297df501 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:24.098214 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc2a99-1949-47ae-8854-74b66321fd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:24.099155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc2a99-1949-47ae-8854-74b66321fd4d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:24.099667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc2a99-1949-47ae-8854-74b66321fd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:24.100400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc2a99-1949-47ae-8854-74b66321fd4d None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:24.102667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc2a99-1949-47ae-8854-74b66321fd4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:24.102982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc2a99-1949-47ae-8854-74b66321fd4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:24.104366 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc2a99-1949-47ae-8854-74b66321fd4d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:24.117604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 363/731] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:24.118921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d341db-8296-481e-97f0-626bdf4d5e66 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:24.119208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d341db-8296-481e-97f0-626bdf4d5e66 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:24.119496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d341db-8296-481e-97f0-626bdf4d5e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:24.137635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d9d341db-8296-481e-97f0-626bdf4d5e66 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:24.138897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d9d341db-8296-481e-97f0-626bdf4d5e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:24.181006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d391436-2b15-4b68-9ca5-3b9b297df501 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:24.217390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 364/732] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:24.217390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d341db-8296-481e-97f0-626bdf4d5e66 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:24.231801 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6540c02-34ba-4972-b92f-30e9eac4436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:24.232779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6540c02-34ba-4972-b92f-30e9eac4436a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:24.233308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6540c02-34ba-4972-b92f-30e9eac4436a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:24.233878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6540c02-34ba-4972-b92f-30e9eac4436a None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:24.234854 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6540c02-34ba-4972-b92f-30e9eac4436a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:24.235458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6540c02-34ba-4972-b92f-30e9eac4436a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:24.237190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6540c02-34ba-4972-b92f-30e9eac4436a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:24.287572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 369/733] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 17 16:06:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:24.294140 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6540c02-34ba-4972-b92f-30e9eac4436a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:24.304640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:24.317560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d341db-8296-481e-97f0-626bdf4d5e66 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:24.323692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:24.355037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ca74d-ed32-4f1e-a6cc-42ca622af8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:24.355733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ca74d-ed32-4f1e-a6cc-42ca622af8ac None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:24.356017 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ca74d-ed32-4f1e-a6cc-42ca622af8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:24.356287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ca74d-ed32-4f1e-a6cc-42ca622af8ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:24.373722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ca74d-ed32-4f1e-a6cc-42ca622af8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:24.375374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ca74d-ed32-4f1e-a6cc-42ca622af8ac None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-5e8ca74d-ed32-4f1e-a6cc-42ca622af8ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:24.392640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:24.393659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:24.394570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:24.394570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:24.394570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:24.394570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 365/734] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:24.400482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ca74d-ed32-4f1e-a6cc-42ca622af8ac None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:24.483155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6540c02-34ba-4972-b92f-30e9eac4436a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:24.574680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ca74d-ed32-4f1e-a6cc-42ca622af8ac None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:24.614247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51088096-a3a3-436f-b762-47951cd7a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:24.615167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51088096-a3a3-436f-b762-47951cd7a83e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:24.615697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51088096-a3a3-436f-b762-47951cd7a83e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:24.616156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51088096-a3a3-436f-b762-47951cd7a83e None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:24.616992 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51088096-a3a3-436f-b762-47951cd7a83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:24.617608 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51088096-a3a3-436f-b762-47951cd7a83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:24.619298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51088096-a3a3-436f-b762-47951cd7a83e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:24.629571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:24.640920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 366/735] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:24.640920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51088096-a3a3-436f-b762-47951cd7a83e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:24.651570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf72ac7-3c50-47d5-b48b-84a5d2ca2575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:24.652357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf72ac7-3c50-47d5-b48b-84a5d2ca2575 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:24.652726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf72ac7-3c50-47d5-b48b-84a5d2ca2575 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:24.653345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf72ac7-3c50-47d5-b48b-84a5d2ca2575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:24.731676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf72ac7-3c50-47d5-b48b-84a5d2ca2575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:24.733546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf72ac7-3c50-47d5-b48b-84a5d2ca2575 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:24.749482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:24.762108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51088096-a3a3-436f-b762-47951cd7a83e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:24.807783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b6ead-95d5-4624-9f94-c178fd835dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:24.808682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6ead-95d5-4624-9f94-c178fd835dd3 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:24.808964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6ead-95d5-4624-9f94-c178fd835dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:24.809238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6ead-95d5-4624-9f94-c178fd835dd3 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:24.809914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b6ead-95d5-4624-9f94-c178fd835dd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:24.811458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b6ead-95d5-4624-9f94-c178fd835dd3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:24.845255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 370/736] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:06:24.846475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf72ac7-3c50-47d5-b48b-84a5d2ca2575 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:24.925504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 367/737] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:06:24 2022] POST /identity/v3/services => generated 251 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:24.925504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b6ead-95d5-4624-9f94-c178fd835dd3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:24.965528 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf72ac7-3c50-47d5-b48b-84a5d2ca2575 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:24.982896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:24.996921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:25.013962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6632ab-7501-4bbf-a907-32571497b740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:25.015160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6632ab-7501-4bbf-a907-32571497b740 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:25.015797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6632ab-7501-4bbf-a907-32571497b740 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:25.016409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6632ab-7501-4bbf-a907-32571497b740 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:25.025015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6632ab-7501-4bbf-a907-32571497b740 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:25.026935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6632ab-7501-4bbf-a907-32571497b740 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0d6632ab-7501-4bbf-a907-32571497b740 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:25.040479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:25.042165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:25.043098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:25.043098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:25.043098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:25.043098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:25.043098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:25.043098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:25.043098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:25.043098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:25.043098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:25.043098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:25.045783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 371/738] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:25.047333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89850c0-a7b7-4ce4-860c-6fb805987e90 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:25.047781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89850c0-a7b7-4ce4-860c-6fb805987e90 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:25.048228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89850c0-a7b7-4ce4-860c-6fb805987e90 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:25.054046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 372/739] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:25.056221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad063-b905-4aa9-a222-1bccb5d355fc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:25.056724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad063-b905-4aa9-a222-1bccb5d355fc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:25.057173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad063-b905-4aa9-a222-1bccb5d355fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:25.063294 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b6ead-95d5-4624-9f94-c178fd835dd3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:25.078373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d8fad063-b905-4aa9-a222-1bccb5d355fc None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:25.079853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d8fad063-b905-4aa9-a222-1bccb5d355fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:25.103608 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf244e-6b8d-45ee-8802-d15682f40911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:25.104588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf244e-6b8d-45ee-8802-d15682f40911 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:25.104588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf244e-6b8d-45ee-8802-d15682f40911 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:25.104773 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf244e-6b8d-45ee-8802-d15682f40911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:25.117456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf244e-6b8d-45ee-8802-d15682f40911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:25.119325 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf244e-6b8d-45ee-8802-d15682f40911 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-1ecf244e-6b8d-45ee-8802-d15682f40911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:25.138203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:25.139190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:25.140083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:25.140083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:25.140083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:25.140083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 368/740] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:25.140315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf244e-6b8d-45ee-8802-d15682f40911 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:25.160142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 373/741] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:06:25.161248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fad063-b905-4aa9-a222-1bccb5d355fc None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:25.254796 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf244e-6b8d-45ee-8802-d15682f40911 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:25.276536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:25.324863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193169f-4aa1-48ef-98ea-4e45ed0608e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:25.326948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193169f-4aa1-48ef-98ea-4e45ed0608e3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:25.327231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193169f-4aa1-48ef-98ea-4e45ed0608e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:25.327505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193169f-4aa1-48ef-98ea-4e45ed0608e3 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:25.328245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193169f-4aa1-48ef-98ea-4e45ed0608e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:25.328549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193169f-4aa1-48ef-98ea-4e45ed0608e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:25.330011 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193169f-4aa1-48ef-98ea-4e45ed0608e3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:25.337637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:25.341761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fad063-b905-4aa9-a222-1bccb5d355fc None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:25.368584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 369/742] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 17 16:06:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:25.374863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193169f-4aa1-48ef-98ea-4e45ed0608e3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:25.410575 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef71b1-a647-46eb-a40b-e123eb83941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:25.411492 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef71b1-a647-46eb-a40b-e123eb83941d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:25.411765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef71b1-a647-46eb-a40b-e123eb83941d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:25.412030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef71b1-a647-46eb-a40b-e123eb83941d None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:25.412741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef71b1-a647-46eb-a40b-e123eb83941d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:25.413036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef71b1-a647-46eb-a40b-e123eb83941d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:25.415170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef71b1-a647-46eb-a40b-e123eb83941d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:25.428442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 374/743] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:25.436554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef71b1-a647-46eb-a40b-e123eb83941d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:25.547003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193169f-4aa1-48ef-98ea-4e45ed0608e3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:25.578658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef71b1-a647-46eb-a40b-e123eb83941d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:25.588909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10753f18-62a3-4e41-bfd5-01ca7f9885f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:25.589600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753f18-62a3-4e41-bfd5-01ca7f9885f0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:25.589881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753f18-62a3-4e41-bfd5-01ca7f9885f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:25.590150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753f18-62a3-4e41-bfd5-01ca7f9885f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:25.615278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f31ef-eb5b-4bce-a36e-b03eb87ec7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:25.616027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f31ef-eb5b-4bce-a36e-b03eb87ec7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:25.616460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f31ef-eb5b-4bce-a36e-b03eb87ec7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:25.616735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f31ef-eb5b-4bce-a36e-b03eb87ec7e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:25.624906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f31ef-eb5b-4bce-a36e-b03eb87ec7e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:25.626451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f31ef-eb5b-4bce-a36e-b03eb87ec7e0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:25.628081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-398f31ef-eb5b-4bce-a36e-b03eb87ec7e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:25.644222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:25.650532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:25.651431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:25.651431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:25.651431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:25.651431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:25.651431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:25.651431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:25.651431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:25.651431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:25.652264 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 375/744] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:25.653382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f31ef-eb5b-4bce-a36e-b03eb87ec7e0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:25.668834 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10753f18-62a3-4e41-bfd5-01ca7f9885f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:25.670554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10753f18-62a3-4e41-bfd5-01ca7f9885f0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:25.684452 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:25.784237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f31ef-eb5b-4bce-a36e-b03eb87ec7e0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:25.810177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 370/745] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:25 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:06:25.810177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10753f18-62a3-4e41-bfd5-01ca7f9885f0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:25.832333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e64434-e41f-4d62-8c0d-e18b1f963db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:25.832918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e64434-e41f-4d62-8c0d-e18b1f963db0 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:25.833195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e64434-e41f-4d62-8c0d-e18b1f963db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:25.833508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e64434-e41f-4d62-8c0d-e18b1f963db0 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:25.834159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e64434-e41f-4d62-8c0d-e18b1f963db0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:25.835644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e64434-e41f-4d62-8c0d-e18b1f963db0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:25.891111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:25.891878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 376/746] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:06:25 2022] POST /identity/v3/services => generated 240 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:25.892822 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e64434-e41f-4d62-8c0d-e18b1f963db0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:25.940186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10753f18-62a3-4e41-bfd5-01ca7f9885f0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:26.004886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d743b-395d-4918-9030-c07519ed59e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:26.005660 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d743b-395d-4918-9030-c07519ed59e8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:26.006007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d743b-395d-4918-9030-c07519ed59e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:26.006347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d743b-395d-4918-9030-c07519ed59e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:26.007198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d743b-395d-4918-9030-c07519ed59e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:26.008137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d743b-395d-4918-9030-c07519ed59e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:26.010321 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d743b-395d-4918-9030-c07519ed59e8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:26.012966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:26.029534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 371/747] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:26.031299 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd22e89-ba92-4570-a799-6d86baaa2ace None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:26.031743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd22e89-ba92-4570-a799-6d86baaa2ace None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:26.032184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd22e89-ba92-4570-a799-6d86baaa2ace None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:26.037822 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 372/748] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:26.038446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd22e89-ba92-4570-a799-6d86baaa2ace None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:26.046323 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e64434-e41f-4d62-8c0d-e18b1f963db0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:26.094478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d823f-8a3b-43b3-9848-1cc8a1bf5d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:26.095045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d823f-8a3b-43b3-9848-1cc8a1bf5d10 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:26.095323 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d823f-8a3b-43b3-9848-1cc8a1bf5d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:26.095595 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d823f-8a3b-43b3-9848-1cc8a1bf5d10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:26.107080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d823f-8a3b-43b3-9848-1cc8a1bf5d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:26.108700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d823f-8a3b-43b3-9848-1cc8a1bf5d10 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-1b4d823f-8a3b-43b3-9848-1cc8a1bf5d10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:26.127197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:26.128392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:26.129279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:26.129279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:26.129279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:26.129279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 377/749] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:26.129279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059416bc-8de9-4f2f-8616-7d7ee2ec43e2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:26.129606 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059416bc-8de9-4f2f-8616-7d7ee2ec43e2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:26.133763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059416bc-8de9-4f2f-8616-7d7ee2ec43e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:26.153153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-059416bc-8de9-4f2f-8616-7d7ee2ec43e2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:26.154385 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-059416bc-8de9-4f2f-8616-7d7ee2ec43e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:26.174669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd22e89-ba92-4570-a799-6d86baaa2ace None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:26.203401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:26.215900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586cec5-11ac-424f-a65a-08613e0b8039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:26.221492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586cec5-11ac-424f-a65a-08613e0b8039 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:26.221492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586cec5-11ac-424f-a65a-08613e0b8039 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:26.221492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586cec5-11ac-424f-a65a-08613e0b8039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:26.221492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586cec5-11ac-424f-a65a-08613e0b8039 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=666d255c72394f4e9faaeb5b94253cf1) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:26.221492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586cec5-11ac-424f-a65a-08613e0b8039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:26.221492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586cec5-11ac-424f-a65a-08613e0b8039 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:26.227670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 373/750] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:26 2022] GET /identity/v3/role_assignments?user.id=666d255c72394f4e9faaeb5b94253cf1&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:26.228713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586cec5-11ac-424f-a65a-08613e0b8039 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:26.258900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 378/751] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:26.401113 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586cec5-11ac-424f-a65a-08613e0b8039 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:26.442215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e203cc-3ac2-455d-886f-25403db6b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:26.443063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e203cc-3ac2-455d-886f-25403db6b523 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:26.443488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e203cc-3ac2-455d-886f-25403db6b523 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:26.444189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e203cc-3ac2-455d-886f-25403db6b523 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:26.444975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e203cc-3ac2-455d-886f-25403db6b523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:26.445491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e203cc-3ac2-455d-886f-25403db6b523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:26.447001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e203cc-3ac2-455d-886f-25403db6b523 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:26.460923 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 374/752] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:26.466839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059416bc-8de9-4f2f-8616-7d7ee2ec43e2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:26.560737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:26.605533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059416bc-8de9-4f2f-8616-7d7ee2ec43e2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:26.610512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e203cc-3ac2-455d-886f-25403db6b523 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:26.672021 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a3e7-e39d-4b9a-885f-3f57859a4cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:26.672580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a3e7-e39d-4b9a-885f-3f57859a4cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:26.672859 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a3e7-e39d-4b9a-885f-3f57859a4cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:26.673130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a3e7-e39d-4b9a-885f-3f57859a4cf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:26.690447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307a3e7-e39d-4b9a-885f-3f57859a4cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:26.691983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307a3e7-e39d-4b9a-885f-3f57859a4cf4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:26.709736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a307a3e7-e39d-4b9a-885f-3f57859a4cf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:26.715448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:26.716369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:26.717272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:26.717272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:26.717272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:26.717272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:26.717272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:26.717272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:26.717272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:26.717272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:26.727557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 379/753] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:26.727557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a3e7-e39d-4b9a-885f-3f57859a4cf4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:26.735233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e203cc-3ac2-455d-886f-25403db6b523 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:26.773153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09705cf3-6274-44ed-9ebf-0f98a47f507e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:26.774576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09705cf3-6274-44ed-9ebf-0f98a47f507e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:26.774833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09705cf3-6274-44ed-9ebf-0f98a47f507e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:26.775257 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09705cf3-6274-44ed-9ebf-0f98a47f507e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:26.786633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09705cf3-6274-44ed-9ebf-0f98a47f507e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-09705cf3-6274-44ed-9ebf-0f98a47f507e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:26.791990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:26.794144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:26.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 375/754] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:26.803069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09705cf3-6274-44ed-9ebf-0f98a47f507e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:26.922730 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09705cf3-6274-44ed-9ebf-0f98a47f507e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:26.934411 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:26.961938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad313d8-e858-416d-b813-84f95e15f230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:26.962833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad313d8-e858-416d-b813-84f95e15f230 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:26.963252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad313d8-e858-416d-b813-84f95e15f230 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:26.963661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad313d8-e858-416d-b813-84f95e15f230 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:26.964463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad313d8-e858-416d-b813-84f95e15f230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:26.964899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad313d8-e858-416d-b813-84f95e15f230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:26.966694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad313d8-e858-416d-b813-84f95e15f230 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:26.981041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 376/755] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:26.982491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad313d8-e858-416d-b813-84f95e15f230 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:27.097132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad313d8-e858-416d-b813-84f95e15f230 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:27.107326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a3e7-e39d-4b9a-885f-3f57859a4cf4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:27.136419 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65526-4968-486e-b1c2-aa0c7e34f25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:27.137446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65526-4968-486e-b1c2-aa0c7e34f25a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.137890 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65526-4968-486e-b1c2-aa0c7e34f25a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.138300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65526-4968-486e-b1c2-aa0c7e34f25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.150142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e65526-4968-486e-b1c2-aa0c7e34f25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:27.152023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e65526-4968-486e-b1c2-aa0c7e34f25a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-14e65526-4968-486e-b1c2-aa0c7e34f25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:27.167617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:27.168590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:27.169508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:27.169508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:27.169508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:27.176477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:27.177111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 377/756] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:27.179265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65526-4968-486e-b1c2-aa0c7e34f25a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:27.225726 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:27.238148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a358c33-e91d-46c3-8ef5-1c2bfa77121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:27.238862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358c33-e91d-46c3-8ef5-1c2bfa77121a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.248055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358c33-e91d-46c3-8ef5-1c2bfa77121a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.248055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358c33-e91d-46c3-8ef5-1c2bfa77121a None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.248055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a358c33-e91d-46c3-8ef5-1c2bfa77121a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:27.248055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a358c33-e91d-46c3-8ef5-1c2bfa77121a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:27.248055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a358c33-e91d-46c3-8ef5-1c2bfa77121a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:27.268626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 380/757] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 542 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:27.270059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16c83-6e72-4c45-9e0c-389dec11ac5f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.270414 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16c83-6e72-4c45-9e0c-389dec11ac5f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.270821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16c83-6e72-4c45-9e0c-389dec11ac5f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.272311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 381/758] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:27.274507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf16c83-6e72-4c45-9e0c-389dec11ac5f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:27.295455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65526-4968-486e-b1c2-aa0c7e34f25a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:27.344828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1d351-639c-4d7f-8f50-b24f7b524684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:27.345660 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d351-639c-4d7f-8f50-b24f7b524684 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.346036 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d351-639c-4d7f-8f50-b24f7b524684 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.346503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d351-639c-4d7f-8f50-b24f7b524684 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.347249 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1d351-639c-4d7f-8f50-b24f7b524684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:27.347697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1d351-639c-4d7f-8f50-b24f7b524684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:27.349337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1d351-639c-4d7f-8f50-b24f7b524684 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:27.363892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 378/759] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:27.365397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed8ca-7bb1-4cb9-b593-1f12b4cf9517 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.365779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed8ca-7bb1-4cb9-b593-1f12b4cf9517 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.366170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed8ca-7bb1-4cb9-b593-1f12b4cf9517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.385788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8a1ed8ca-7bb1-4cb9-b593-1f12b4cf9517 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:27.387308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8a1ed8ca-7bb1-4cb9-b593-1f12b4cf9517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:27.396341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf16c83-6e72-4c45-9e0c-389dec11ac5f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:27.432628 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f16519-0c80-4d77-a32d-e1152e2475fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:27.433162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f16519-0c80-4d77-a32d-e1152e2475fb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.433476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f16519-0c80-4d77-a32d-e1152e2475fb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.433751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f16519-0c80-4d77-a32d-e1152e2475fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.434483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f16519-0c80-4d77-a32d-e1152e2475fb None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=6a2326353998441c938abf274b5e5dd4) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:27.434782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f16519-0c80-4d77-a32d-e1152e2475fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:27.436204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f16519-0c80-4d77-a32d-e1152e2475fb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:27.442357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 382/760] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:27 2022] GET /identity/v3/role_assignments?user.id=6a2326353998441c938abf274b5e5dd4&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=28beda93f70d4c549352145ddee01aac => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:27.443174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f16519-0c80-4d77-a32d-e1152e2475fb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:27.465951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 379/761] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:27.495697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:27.556196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f16519-0c80-4d77-a32d-e1152e2475fb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:27.594771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409dbf2-a371-4d8a-9fc1-0b328b74c746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:27.595417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409dbf2-a371-4d8a-9fc1-0b328b74c746 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.595694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409dbf2-a371-4d8a-9fc1-0b328b74c746 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.595968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409dbf2-a371-4d8a-9fc1-0b328b74c746 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.604937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409dbf2-a371-4d8a-9fc1-0b328b74c746 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:27.606418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409dbf2-a371-4d8a-9fc1-0b328b74c746 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3409dbf2-a371-4d8a-9fc1-0b328b74c746 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:27.618661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:27.619611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:27.620591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:27.620591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:27.620591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:27.620591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:27.620591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:27.620591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:27.620591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:27.620591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:27.620591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:27.620591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:27.620591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 383/762] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 17 16:06:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:27.625771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ed8ca-7bb1-4cb9-b593-1f12b4cf9517 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:27.648477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:27.791680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ed8ca-7bb1-4cb9-b593-1f12b4cf9517 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:27.819340 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409dbf2-a371-4d8a-9fc1-0b328b74c746 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:27.832419 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80f7e7-15ee-4101-91fd-707cf01b9d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:27.833351 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80f7e7-15ee-4101-91fd-707cf01b9d17 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.833823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80f7e7-15ee-4101-91fd-707cf01b9d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.834273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80f7e7-15ee-4101-91fd-707cf01b9d17 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.835338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80f7e7-15ee-4101-91fd-707cf01b9d17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:27.835855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80f7e7-15ee-4101-91fd-707cf01b9d17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:27.838335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80f7e7-15ee-4101-91fd-707cf01b9d17 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:27.868909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 380/763] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 17 16:06:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:27.874067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80f7e7-15ee-4101-91fd-707cf01b9d17 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:27.970054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409dbf2-a371-4d8a-9fc1-0b328b74c746 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:27.983550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:28.005744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:28.025225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67adc8-ec63-4ce6-8e63-6c8df0eb4066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:28.026331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67adc8-ec63-4ce6-8e63-6c8df0eb4066 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.028642 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67adc8-ec63-4ce6-8e63-6c8df0eb4066 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.029170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67adc8-ec63-4ce6-8e63-6c8df0eb4066 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.029972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67adc8-ec63-4ce6-8e63-6c8df0eb4066 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:28.031537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67adc8-ec63-4ce6-8e63-6c8df0eb4066 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2c67adc8-ec63-4ce6-8e63-6c8df0eb4066 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:28.050773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:28.051826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:06:28.052654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:28.061225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 384/764] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 17 16:06:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:28.065558 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67adc8-ec63-4ce6-8e63-6c8df0eb4066 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:28.069411 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80f7e7-15ee-4101-91fd-707cf01b9d17 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:28.108662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c4042-0cd3-4a19-ae83-da6b68890c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:28.109311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c4042-0cd3-4a19-ae83-da6b68890c3c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.109623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c4042-0cd3-4a19-ae83-da6b68890c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.109896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c4042-0cd3-4a19-ae83-da6b68890c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.123848 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c4042-0cd3-4a19-ae83-da6b68890c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:28.125332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c4042-0cd3-4a19-ae83-da6b68890c3c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-668c4042-0cd3-4a19-ae83-da6b68890c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:28.141182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:28.142869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:28.143781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:28.143781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:28.143781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:28.143781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 381/765] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:28.144008 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6943-cd9f-48ba-9ec2-a9403dcf516e None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.144526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6943-cd9f-48ba-9ec2-a9403dcf516e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.144526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6943-cd9f-48ba-9ec2-a9403dcf516e None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.150734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 382/766] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:28.152195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96141624-4ffe-4179-8e38-5f485a273c60 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.152483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96141624-4ffe-4179-8e38-5f485a273c60 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.152759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96141624-4ffe-4179-8e38-5f485a273c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.173199 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-96141624-4ffe-4179-8e38-5f485a273c60 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:28.174521 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-96141624-4ffe-4179-8e38-5f485a273c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:28.189523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67adc8-ec63-4ce6-8e63-6c8df0eb4066 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:28.230085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e958-1f0b-43cc-96fa-9dad58002bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:28.231101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e958-1f0b-43cc-96fa-9dad58002bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.231582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e958-1f0b-43cc-96fa-9dad58002bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.232526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e958-1f0b-43cc-96fa-9dad58002bc4 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.233455 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0e958-1f0b-43cc-96fa-9dad58002bc4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:28.233963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0e958-1f0b-43cc-96fa-9dad58002bc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:28.236484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0e958-1f0b-43cc-96fa-9dad58002bc4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:28.245007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 385/767] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 17 16:06:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:28.246245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e958-1f0b-43cc-96fa-9dad58002bc4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:28.274092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 383/768] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:28.274800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96141624-4ffe-4179-8e38-5f485a273c60 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:28.292183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:28.379347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e958-1f0b-43cc-96fa-9dad58002bc4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:28.383795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:28.424604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818e3eb-35fa-475f-93fc-aa82423e6c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:28.425814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e3eb-35fa-475f-93fc-aa82423e6c9a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.426304 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e3eb-35fa-475f-93fc-aa82423e6c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.426937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e3eb-35fa-475f-93fc-aa82423e6c9a None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.428215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818e3eb-35fa-475f-93fc-aa82423e6c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:28.428738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818e3eb-35fa-475f-93fc-aa82423e6c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:28.431889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818e3eb-35fa-475f-93fc-aa82423e6c9a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:28.448642 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 386/769] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:28.454902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818e3eb-35fa-475f-93fc-aa82423e6c9a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:28.488703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96141624-4ffe-4179-8e38-5f485a273c60 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:28.537819 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890bb04-7fbc-4fb9-8a28-6b27b18d8132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:28.538442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890bb04-7fbc-4fb9-8a28-6b27b18d8132 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.538719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890bb04-7fbc-4fb9-8a28-6b27b18d8132 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.538983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890bb04-7fbc-4fb9-8a28-6b27b18d8132 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.540234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890bb04-7fbc-4fb9-8a28-6b27b18d8132 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:28.540516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890bb04-7fbc-4fb9-8a28-6b27b18d8132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:28.542012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890bb04-7fbc-4fb9-8a28-6b27b18d8132 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:28.552653 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 384/770] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 17 16:06:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:28.553962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640f713-05d1-4ddc-85cc-254f661c1357 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.554265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640f713-05d1-4ddc-85cc-254f661c1357 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.554893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640f713-05d1-4ddc-85cc-254f661c1357 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.556757 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 385/771] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:28.561772 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640f713-05d1-4ddc-85cc-254f661c1357 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:28.614736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:28.622178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818e3eb-35fa-475f-93fc-aa82423e6c9a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:28.659400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f411ef-e123-4254-b816-d5e4bc958114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:28.659959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f411ef-e123-4254-b816-d5e4bc958114 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.660240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f411ef-e123-4254-b816-d5e4bc958114 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.660493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f411ef-e123-4254-b816-d5e4bc958114 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.668157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f411ef-e123-4254-b816-d5e4bc958114 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:28.669657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f411ef-e123-4254-b816-d5e4bc958114 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:28.678607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640f713-05d1-4ddc-85cc-254f661c1357 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-35f411ef-e123-4254-b816-d5e4bc958114 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:28.682134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:28.683061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:28.683951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:28.683951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:28.683951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:28.683951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:28.683951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:28.683951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:28.683951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:28.683951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:28.688201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 387/772] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:28.689636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ef13b-f61d-4164-93ef-36a7982e232e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.689939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ef13b-f61d-4164-93ef-36a7982e232e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.690194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ef13b-f61d-4164-93ef-36a7982e232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.698632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:28.709222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f68ef13b-f61d-4164-93ef-36a7982e232e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:28.710766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f68ef13b-f61d-4164-93ef-36a7982e232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:28.727657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4e76-a394-422f-8b5e-4965dafaf401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:28.728384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4e76-a394-422f-8b5e-4965dafaf401 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.728680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4e76-a394-422f-8b5e-4965dafaf401 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.729311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4e76-a394-422f-8b5e-4965dafaf401 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.730175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a4e76-a394-422f-8b5e-4965dafaf401 None admin] RBAC: Adding query filter params (interface=public, service_id=66baf527b03b44fcb2adb6493b68b069, region_id=RegionOne) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:28.730657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a4e76-a394-422f-8b5e-4965dafaf401 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:28.732136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a4e76-a394-422f-8b5e-4965dafaf401 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:28.740897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 386/773] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 17 16:06:28 2022] GET /identity/v3/endpoints?service_id=66baf527b03b44fcb2adb6493b68b069&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:28.741768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4e76-a394-422f-8b5e-4965dafaf401 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:28.800820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 388/774] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:28.801532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ef13b-f61d-4164-93ef-36a7982e232e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:28.865546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4e76-a394-422f-8b5e-4965dafaf401 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:28.909384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c54b4-eb00-487c-8716-2ddcca4b0d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:28.909384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c54b4-eb00-487c-8716-2ddcca4b0d92 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.909384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c54b4-eb00-487c-8716-2ddcca4b0d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.909384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c54b4-eb00-487c-8716-2ddcca4b0d92 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.909852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c54b4-eb00-487c-8716-2ddcca4b0d92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:28.909852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c54b4-eb00-487c-8716-2ddcca4b0d92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:28.910569 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c54b4-eb00-487c-8716-2ddcca4b0d92 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:28.924694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 387/775] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:28.925665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c54b4-eb00-487c-8716-2ddcca4b0d92 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:28.932300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:28.955522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ef13b-f61d-4164-93ef-36a7982e232e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:28.974548 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:28.995457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88ca9c-fb44-43a3-b7ae-6dc51f0edc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:28.996437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88ca9c-fb44-43a3-b7ae-6dc51f0edc89 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.996920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88ca9c-fb44-43a3-b7ae-6dc51f0edc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.997428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88ca9c-fb44-43a3-b7ae-6dc51f0edc89 None admin] PATH_INFO: `/v3/services/network` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:29.001891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88ca9c-fb44-43a3-b7ae-6dc51f0edc89 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:29.001891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88ca9c-fb44-43a3-b7ae-6dc51f0edc89 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ad88ca9c-fb44-43a3-b7ae-6dc51f0edc89 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:29.009690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:29.011420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:06:29.013166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:29.017784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 389/776] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:28 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:29.024552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88ca9c-fb44-43a3-b7ae-6dc51f0edc89 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:29.042735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c54b4-eb00-487c-8716-2ddcca4b0d92 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:29.081870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd1935-5b59-4060-a54c-08b551ccbc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:29.082617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd1935-5b59-4060-a54c-08b551ccbc55 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:29.082956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd1935-5b59-4060-a54c-08b551ccbc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:29.083337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd1935-5b59-4060-a54c-08b551ccbc55 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:29.084002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd1935-5b59-4060-a54c-08b551ccbc55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:29.085647 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd1935-5b59-4060-a54c-08b551ccbc55 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:29.093605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 388/777] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 17 16:06:28 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:29.094667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd1935-5b59-4060-a54c-08b551ccbc55 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:29.154834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88ca9c-fb44-43a3-b7ae-6dc51f0edc89 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:29.209171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc6728-6b59-4994-bd3d-c120daec20f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:29.210699 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6728-6b59-4994-bd3d-c120daec20f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:29.211952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6728-6b59-4994-bd3d-c120daec20f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:29.212606 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6728-6b59-4994-bd3d-c120daec20f8 None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/f99edbaee8504487863c6fa4b551c224/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:29.215128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc6728-6b59-4994-bd3d-c120daec20f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=f99edbaee8504487863c6fa4b551c224, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:29.216885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc6728-6b59-4994-bd3d-c120daec20f8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:29.219390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd1935-5b59-4060-a54c-08b551ccbc55 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:29.222313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:29.292102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 390/778] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:06:29 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/f99edbaee8504487863c6fa4b551c224/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:06:29.293647 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc6728-6b59-4994-bd3d-c120daec20f8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:29.308807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:29.430839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1dd9e-91ec-432b-aa80-9c5a3114864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:29.431535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1dd9e-91ec-432b-aa80-9c5a3114864b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:29.432336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1dd9e-91ec-432b-aa80-9c5a3114864b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:29.432336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1dd9e-91ec-432b-aa80-9c5a3114864b None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:29.432644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1dd9e-91ec-432b-aa80-9c5a3114864b None admin] RBAC: Adding query filter params (name=network) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:29.432944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1dd9e-91ec-432b-aa80-9c5a3114864b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:29.434377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1dd9e-91ec-432b-aa80-9c5a3114864b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:29.444009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 389/779] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:29.450531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1dd9e-91ec-432b-aa80-9c5a3114864b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:29.483564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc6728-6b59-4994-bd3d-c120daec20f8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:29.539961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dee90e-85a8-4dbd-a7ad-5b2ee6d0cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:29.540603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee90e-85a8-4dbd-a7ad-5b2ee6d0cdbe None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:29.540877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee90e-85a8-4dbd-a7ad-5b2ee6d0cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:29.541145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dee90e-85a8-4dbd-a7ad-5b2ee6d0cdbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:29.575228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dee90e-85a8-4dbd-a7ad-5b2ee6d0cdbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-33dee90e-85a8-4dbd-a7ad-5b2ee6d0cdbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:29.579924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:29.580940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:29.581843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:29.583885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1dd9e-91ec-432b-aa80-9c5a3114864b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:29.589870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 391/780] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:29.595727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dee90e-85a8-4dbd-a7ad-5b2ee6d0cdbe None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:29.621381 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3879c6a-5e0a-4a23-8122-0e244c460711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:29.622028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3879c6a-5e0a-4a23-8122-0e244c460711 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:29.622312 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3879c6a-5e0a-4a23-8122-0e244c460711 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:29.622579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3879c6a-5e0a-4a23-8122-0e244c460711 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:29.623329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3879c6a-5e0a-4a23-8122-0e244c460711 None admin] RBAC: Adding query filter params (type=network) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:29.623629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3879c6a-5e0a-4a23-8122-0e244c460711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:29.624998 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3879c6a-5e0a-4a23-8122-0e244c460711 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:29.630938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 390/781] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:29.643013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3879c6a-5e0a-4a23-8122-0e244c460711 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:29.682761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:29.711525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:29.760153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3879c6a-5e0a-4a23-8122-0e244c460711 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:29.764561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dee90e-85a8-4dbd-a7ad-5b2ee6d0cdbe None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:29.799573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e16618-cd20-4990-bf1b-915047132944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:29.801593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e16618-cd20-4990-bf1b-915047132944 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:29.801875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e16618-cd20-4990-bf1b-915047132944 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:29.802143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e16618-cd20-4990-bf1b-915047132944 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:29.802850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e16618-cd20-4990-bf1b-915047132944 None admin] RBAC: Adding query filter params (interface=public, service_id=e38757d8bf6f4b74ae7540922faa4aea, region_id=RegionOne) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:29.803153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e16618-cd20-4990-bf1b-915047132944 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:29.804516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e16618-cd20-4990-bf1b-915047132944 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:29.807286 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb20cf-1935-48bd-981e-31b2d5f768b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:29.808306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb20cf-1935-48bd-981e-31b2d5f768b9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:29.808794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb20cf-1935-48bd-981e-31b2d5f768b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:29.809285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb20cf-1935-48bd-981e-31b2d5f768b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:29.810197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb20cf-1935-48bd-981e-31b2d5f768b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:29.810712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb20cf-1935-48bd-981e-31b2d5f768b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:29.811147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 391/782] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 17 16:06:29 2022] GET /identity/v3/endpoints?service_id=e38757d8bf6f4b74ae7540922faa4aea&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:29.812498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa804328-33fc-409c-b6fd-d5f161807dda None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:29.812760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb20cf-1935-48bd-981e-31b2d5f768b9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:29.812866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa804328-33fc-409c-b6fd-d5f161807dda None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:29.813036 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa804328-33fc-409c-b6fd-d5f161807dda None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:29.818739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 392/783] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:29.818739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa804328-33fc-409c-b6fd-d5f161807dda None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:29.827400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 392/784] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:29.828981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c1b0d-2d15-4e7b-95d4-a0670185e508 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:29.829622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c1b0d-2d15-4e7b-95d4-a0670185e508 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:29.830116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c1b0d-2d15-4e7b-95d4-a0670185e508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:29.849121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-609c1b0d-2d15-4e7b-95d4-a0670185e508 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:29.850792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-609c1b0d-2d15-4e7b-95d4-a0670185e508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:29.923472 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:29.933712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 393/785] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:29.934351 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa804328-33fc-409c-b6fd-d5f161807dda None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:29.935058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c1b0d-2d15-4e7b-95d4-a0670185e508 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:29.980813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cf986-b61b-4496-a052-b56b0317e655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:29.981506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cf986-b61b-4496-a052-b56b0317e655 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:29.981785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cf986-b61b-4496-a052-b56b0317e655 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:29.982139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cf986-b61b-4496-a052-b56b0317e655 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:29.982824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cf986-b61b-4496-a052-b56b0317e655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:29.984302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cf986-b61b-4496-a052-b56b0317e655 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:29.990648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 393/786] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 17 16:06:29 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:30.049929 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:30.105970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c1b0d-2d15-4e7b-95d4-a0670185e508 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:30.150766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24743fd4-b607-4601-9c4b-61e1ce26a508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:30.151412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24743fd4-b607-4601-9c4b-61e1ce26a508 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.151683 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24743fd4-b607-4601-9c4b-61e1ce26a508 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.151951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24743fd4-b607-4601-9c4b-61e1ce26a508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.163180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24743fd4-b607-4601-9c4b-61e1ce26a508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:30.165308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24743fd4-b607-4601-9c4b-61e1ce26a508 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-24743fd4-b607-4601-9c4b-61e1ce26a508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:30.179807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:30.181091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:30.182020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:30.182020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:30.182020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:30.185551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 394/787] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:30.186912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cf986-b61b-4496-a052-b56b0317e655 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:30.230763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24743fd4-b607-4601-9c4b-61e1ce26a508 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:30.301576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cf986-b61b-4496-a052-b56b0317e655 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:30.356466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24743fd4-b607-4601-9c4b-61e1ce26a508 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:30.371985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:30.394805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c80b18-8b78-426f-905d-cfcbf4f8369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:30.395375 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dfb01-a959-4cec-bdf3-19b20ce1192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:30.395995 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dfb01-a959-4cec-bdf3-19b20ce1192a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.396266 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dfb01-a959-4cec-bdf3-19b20ce1192a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.396528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dfb01-a959-4cec-bdf3-19b20ce1192a None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.396755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c80b18-8b78-426f-905d-cfcbf4f8369a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.397182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dfb01-a959-4cec-bdf3-19b20ce1192a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:30.397496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dfb01-a959-4cec-bdf3-19b20ce1192a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:30.397794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c80b18-8b78-426f-905d-cfcbf4f8369a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.398287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c80b18-8b78-426f-905d-cfcbf4f8369a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.399590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dfb01-a959-4cec-bdf3-19b20ce1192a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:30.411781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c80b18-8b78-426f-905d-cfcbf4f8369a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-98c80b18-8b78-426f-905d-cfcbf4f8369a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:30.417833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:30.418778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:30.419657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:30.422522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 395/788] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:30.427387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 394/789] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:30.428567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c80b18-8b78-426f-905d-cfcbf4f8369a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:30.428864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dfb01-a959-4cec-bdf3-19b20ce1192a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:30.476484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:30.596975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dfb01-a959-4cec-bdf3-19b20ce1192a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:30.615045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c80b18-8b78-426f-905d-cfcbf4f8369a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:30.653094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c64188-7ee6-4858-b31b-6ef96129b00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:30.653763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c64188-7ee6-4858-b31b-6ef96129b00e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.654038 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c64188-7ee6-4858-b31b-6ef96129b00e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.654422 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c64188-7ee6-4858-b31b-6ef96129b00e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.662528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c64188-7ee6-4858-b31b-6ef96129b00e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:30.664578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c64188-7ee6-4858-b31b-6ef96129b00e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a7c64188-7ee6-4858-b31b-6ef96129b00e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:30.676508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:30.677508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:30.678534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:30.678534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:30.678534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:30.678534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:30.678534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:30.678534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:30.678534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:30.678534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:30.678534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:30.678534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:30.678534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 395/790] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 17 16:06:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:30.686583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c64188-7ee6-4858-b31b-6ef96129b00e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:30.694599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8adb4-c985-47bb-9fba-733be1d3217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:30.695550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8adb4-c985-47bb-9fba-733be1d3217f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.696069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8adb4-c985-47bb-9fba-733be1d3217f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.696605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8adb4-c985-47bb-9fba-733be1d3217f None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.698085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8adb4-c985-47bb-9fba-733be1d3217f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:30.698624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8adb4-c985-47bb-9fba-733be1d3217f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:30.701250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8adb4-c985-47bb-9fba-733be1d3217f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:30.712463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 396/791] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:30.718941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8adb4-c985-47bb-9fba-733be1d3217f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:30.788077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:30.843936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:30.880531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c64188-7ee6-4858-b31b-6ef96129b00e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:30.916079 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8adb4-c985-47bb-9fba-733be1d3217f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:30.948003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a14423-e5d4-4fc1-b379-da58246ff91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:30.948631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14423-e5d4-4fc1-b379-da58246ff91b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.948909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14423-e5d4-4fc1-b379-da58246ff91b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.949180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14423-e5d4-4fc1-b379-da58246ff91b None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.949934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14423-e5d4-4fc1-b379-da58246ff91b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:30.950235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14423-e5d4-4fc1-b379-da58246ff91b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:30.951658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14423-e5d4-4fc1-b379-da58246ff91b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:30.984030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f109f5-14c8-4525-ae60-33d405721bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:30.984676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f109f5-14c8-4525-ae60-33d405721bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.984955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f109f5-14c8-4525-ae60-33d405721bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.985235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f109f5-14c8-4525-ae60-33d405721bd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.990089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 396/792] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 17 16:06:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:30.996235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a14423-e5d4-4fc1-b379-da58246ff91b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:31.005184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f109f5-14c8-4525-ae60-33d405721bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:31.012395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f109f5-14c8-4525-ae60-33d405721bd2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-73f109f5-14c8-4525-ae60-33d405721bd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:31.037600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:31.038576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:31.040296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:31.040296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:31.040296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:31.042411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 397/793] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:31.045050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f109f5-14c8-4525-ae60-33d405721bd2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:31.169172 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a14423-e5d4-4fc1-b379-da58246ff91b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:31.218002 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:31.242378 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f109f5-14c8-4525-ae60-33d405721bd2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:31.243151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888b43e-4753-41d8-9a08-f01c9c16f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:31.243704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b43e-4753-41d8-9a08-f01c9c16f5ed None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:31.243981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b43e-4753-41d8-9a08-f01c9c16f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:31.244243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b43e-4753-41d8-9a08-f01c9c16f5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:31.253405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:31.258560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888b43e-4753-41d8-9a08-f01c9c16f5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:31.261703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888b43e-4753-41d8-9a08-f01c9c16f5ed None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-2888b43e-4753-41d8-9a08-f01c9c16f5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:31.284731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:31.285970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:31.286994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:31.286994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:31.286994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:31.286994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 397/794] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:31.288818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d425c6-d4fc-4b91-9e44-da4f098d6a12 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:31.289190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d425c6-d4fc-4b91-9e44-da4f098d6a12 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:31.289692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d425c6-d4fc-4b91-9e44-da4f098d6a12 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:31.295204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 398/795] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:31.295204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d425c6-d4fc-4b91-9e44-da4f098d6a12 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:31.296268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b824552-3691-4f5f-b59c-bcfd5418bb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:31.296886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824552-3691-4f5f-b59c-bcfd5418bb8a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:31.297161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824552-3691-4f5f-b59c-bcfd5418bb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:31.297581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824552-3691-4f5f-b59c-bcfd5418bb8a None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:31.298238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b824552-3691-4f5f-b59c-bcfd5418bb8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:31.298626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b824552-3691-4f5f-b59c-bcfd5418bb8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:31.300361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b824552-3691-4f5f-b59c-bcfd5418bb8a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:31.315703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 398/796] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:31.318991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5b575-f5d7-441b-a07d-a432c0fa73c2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:31.319487 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5b575-f5d7-441b-a07d-a432c0fa73c2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:31.319979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5b575-f5d7-441b-a07d-a432c0fa73c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:31.350265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3ba5b575-f5d7-441b-a07d-a432c0fa73c2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:31.351577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3ba5b575-f5d7-441b-a07d-a432c0fa73c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:31.437674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d425c6-d4fc-4b91-9e44-da4f098d6a12 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:31.438013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 399/797] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:31.439128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5b575-f5d7-441b-a07d-a432c0fa73c2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:31.477635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072729-10b1-4656-8643-56ff1b649d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:31.478351 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072729-10b1-4656-8643-56ff1b649d26 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:31.478533 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072729-10b1-4656-8643-56ff1b649d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:31.478803 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072729-10b1-4656-8643-56ff1b649d26 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:31.479512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072729-10b1-4656-8643-56ff1b649d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:31.479822 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072729-10b1-4656-8643-56ff1b649d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:31.481198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072729-10b1-4656-8643-56ff1b649d26 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:31.497548 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 399/798] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:31.502664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072729-10b1-4656-8643-56ff1b649d26 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:31.585595 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:31.591196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:31.614462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5b575-f5d7-441b-a07d-a432c0fa73c2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:31.651592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072729-10b1-4656-8643-56ff1b649d26 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:31.693990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836523d-2167-4e33-ab16-fa377030ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:31.694645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836523d-2167-4e33-ab16-fa377030ce77 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:31.694984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836523d-2167-4e33-ab16-fa377030ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:31.695358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836523d-2167-4e33-ab16-fa377030ce77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:31.700779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a5a5f-b72a-4447-a737-6de065ed01f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:31.701704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a5a5f-b72a-4447-a737-6de065ed01f3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:31.702185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a5a5f-b72a-4447-a737-6de065ed01f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:31.702686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a5a5f-b72a-4447-a737-6de065ed01f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:31.702903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836523d-2167-4e33-ab16-fa377030ce77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:31.709390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836523d-2167-4e33-ab16-fa377030ce77 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-5836523d-2167-4e33-ab16-fa377030ce77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:31.716950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:31.717880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:31.718783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:31.718783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:31.718783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:31.718783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:31.718783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:31.718783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:31.718783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:31.718783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:31.718783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 400/799] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:31.726282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836523d-2167-4e33-ab16-fa377030ce77 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:31.728087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a5a5f-b72a-4447-a737-6de065ed01f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:31.729980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a5a5f-b72a-4447-a737-6de065ed01f3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f03a5a5f-b72a-4447-a737-6de065ed01f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:31.742569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:31.743625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:31.744568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:31.744568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:31.744568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:31.744568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:31.744568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:31.744568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:31.744568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:31.744568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:31.744568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:31.744568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:31.747072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 400/800] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:31.765793 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a5a5f-b72a-4447-a737-6de065ed01f3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:31.850754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836523d-2167-4e33-ab16-fa377030ce77 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:31.862833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:31.883500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a5a5f-b72a-4447-a737-6de065ed01f3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:31.890212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf81cdb-4752-46cd-b8d9-043ac94b9e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:31.891051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf81cdb-4752-46cd-b8d9-043ac94b9e1a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:31.891513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf81cdb-4752-46cd-b8d9-043ac94b9e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:31.891983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf81cdb-4752-46cd-b8d9-043ac94b9e1a None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:31.892862 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf81cdb-4752-46cd-b8d9-043ac94b9e1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:31.893340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf81cdb-4752-46cd-b8d9-043ac94b9e1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:31.895028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf81cdb-4752-46cd-b8d9-043ac94b9e1a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:31.911541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 401/801] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:31.912376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf81cdb-4752-46cd-b8d9-043ac94b9e1a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:31.926631 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e070e-fbb3-4901-96c3-ed580afd75ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:31.927241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e070e-fbb3-4901-96c3-ed580afd75ec None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:31.927508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e070e-fbb3-4901-96c3-ed580afd75ec None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:31.927778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e070e-fbb3-4901-96c3-ed580afd75ec None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:31.928503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e070e-fbb3-4901-96c3-ed580afd75ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:31.928898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e070e-fbb3-4901-96c3-ed580afd75ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:31.930362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e070e-fbb3-4901-96c3-ed580afd75ec None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:31.933007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:31.949392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 401/802] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 17 16:06:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:31.950616 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4688bf1-e0ce-4362-bade-abf6c48c9689 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:31.950898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4688bf1-e0ce-4362-bade-abf6c48c9689 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:31.951293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4688bf1-e0ce-4362-bade-abf6c48c9689 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:31.956830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 402/803] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:31.957578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4688bf1-e0ce-4362-bade-abf6c48c9689 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:32.027664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf81cdb-4752-46cd-b8d9-043ac94b9e1a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:32.062161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc5e8f-6328-4599-bb47-a25f40eb13d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:32.062805 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc5e8f-6328-4599-bb47-a25f40eb13d2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.063081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc5e8f-6328-4599-bb47-a25f40eb13d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.063356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc5e8f-6328-4599-bb47-a25f40eb13d2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.063934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc5e8f-6328-4599-bb47-a25f40eb13d2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:32.065291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc5e8f-6328-4599-bb47-a25f40eb13d2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:32.067037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4688bf1-e0ce-4362-bade-abf6c48c9689 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-d3bc5e8f-6328-4599-bb47-a25f40eb13d2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:32.074761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:32.075771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:32.076609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 402/804] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 17 16:06:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:32.077637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc5e8f-6328-4599-bb47-a25f40eb13d2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:32.110113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e095db2-abcd-449e-a290-24b40d71ccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:32.110733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e095db2-abcd-449e-a290-24b40d71ccd2 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.111006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e095db2-abcd-449e-a290-24b40d71ccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.111276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e095db2-abcd-449e-a290-24b40d71ccd2 None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/666d255c72394f4e9faaeb5b94253cf1/roles/2da610f1e24748d597d353508d98c21e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.115441 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:32.126542 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e095db2-abcd-449e-a290-24b40d71ccd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=666d255c72394f4e9faaeb5b94253cf1, role_id=2da610f1e24748d597d353508d98c21e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:32.128373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e095db2-abcd-449e-a290-24b40d71ccd2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:32.183855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc5e8f-6328-4599-bb47-a25f40eb13d2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:32.209488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 403/805] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:06:31 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/666d255c72394f4e9faaeb5b94253cf1/roles/2da610f1e24748d597d353508d98c21e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:06:32.209488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e4f88-8988-4a34-bc81-98c2a26815ac None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.209488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e4f88-8988-4a34-bc81-98c2a26815ac None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.209488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e4f88-8988-4a34-bc81-98c2a26815ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.227962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ae6e4f88-8988-4a34-bc81-98c2a26815ac None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:32.229290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ae6e4f88-8988-4a34-bc81-98c2a26815ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:32.236553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7b993-7a9f-4caf-8f0d-3d923ece8abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:32.240292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7b993-7a9f-4caf-8f0d-3d923ece8abe None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.240292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7b993-7a9f-4caf-8f0d-3d923ece8abe None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.240292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7b993-7a9f-4caf-8f0d-3d923ece8abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.251161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7b993-7a9f-4caf-8f0d-3d923ece8abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:32.252751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7b993-7a9f-4caf-8f0d-3d923ece8abe None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a5a7b993-7a9f-4caf-8f0d-3d923ece8abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:32.270086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:32.271158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:32.272094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:32.272094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:32.272094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:32.272094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 403/806] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:32.272094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7b993-7a9f-4caf-8f0d-3d923ece8abe None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:32.280794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:32.309128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 404/807] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:32.310520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee39d-2e5f-4dc8-8a33-2877d1896945 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.310802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee39d-2e5f-4dc8-8a33-2877d1896945 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.311098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee39d-2e5f-4dc8-8a33-2877d1896945 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.316647 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 405/808] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:32.316647 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ee39d-2e5f-4dc8-8a33-2877d1896945 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:32.408230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:32.424080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7b993-7a9f-4caf-8f0d-3d923ece8abe None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:32.452342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ee39d-2e5f-4dc8-8a33-2877d1896945 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:32.464360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72777765-ae0b-40f9-9109-576b0eab4bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:32.465004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777765-ae0b-40f9-9109-576b0eab4bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.465427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777765-ae0b-40f9-9109-576b0eab4bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.465772 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777765-ae0b-40f9-9109-576b0eab4bb7 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.466605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72777765-ae0b-40f9-9109-576b0eab4bb7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:32.466969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72777765-ae0b-40f9-9109-576b0eab4bb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:32.468513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72777765-ae0b-40f9-9109-576b0eab4bb7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:32.478817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 404/809] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 17 16:06:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:32.478817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70e0b4-a332-4377-999e-85cd66d9f9cb None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.478817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70e0b4-a332-4377-999e-85cd66d9f9cb None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.478817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70e0b4-a332-4377-999e-85cd66d9f9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.495915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ca70e0b4-a332-4377-999e-85cd66d9f9cb None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:32.497292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ca70e0b4-a332-4377-999e-85cd66d9f9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:32.501489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf104a9a-a58f-4a59-98d7-93425f6bdd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:32.502178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf104a9a-a58f-4a59-98d7-93425f6bdd18 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.502527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf104a9a-a58f-4a59-98d7-93425f6bdd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.502861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf104a9a-a58f-4a59-98d7-93425f6bdd18 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.503577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf104a9a-a58f-4a59-98d7-93425f6bdd18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:32.503944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf104a9a-a58f-4a59-98d7-93425f6bdd18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:32.505407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf104a9a-a58f-4a59-98d7-93425f6bdd18 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:32.521449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 406/810] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:32.522536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf104a9a-a58f-4a59-98d7-93425f6bdd18 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:32.564022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:32.594468 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 405/811] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:32.595325 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70e0b4-a332-4377-999e-85cd66d9f9cb None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:32.646144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf104a9a-a58f-4a59-98d7-93425f6bdd18 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:32.684441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc142f0d-b04c-488d-9f8b-1145d33dc67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:32.685053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc142f0d-b04c-488d-9f8b-1145d33dc67d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.685333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc142f0d-b04c-488d-9f8b-1145d33dc67d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.685706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc142f0d-b04c-488d-9f8b-1145d33dc67d None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.686264 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc142f0d-b04c-488d-9f8b-1145d33dc67d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:32.686564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc142f0d-b04c-488d-9f8b-1145d33dc67d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:32.687943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc142f0d-b04c-488d-9f8b-1145d33dc67d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:32.703882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 407/812] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 17 16:06:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:32.703882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc142f0d-b04c-488d-9f8b-1145d33dc67d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:32.705300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:32.725204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70e0b4-a332-4377-999e-85cd66d9f9cb None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:32.766275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bdd27-d867-4105-834a-301c42121c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:32.766792 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bdd27-d867-4105-834a-301c42121c6c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.767071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bdd27-d867-4105-834a-301c42121c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.767338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bdd27-d867-4105-834a-301c42121c6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.775020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bdd27-d867-4105-834a-301c42121c6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:32.776527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bdd27-d867-4105-834a-301c42121c6c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-436bdd27-d867-4105-834a-301c42121c6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:32.789267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:32.790365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:32.791280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:32.791280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:32.791280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:32.791280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:32.791280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:32.791280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:32.791280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:32.791280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:32.795701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 406/813] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:32.796920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bdd27-d867-4105-834a-301c42121c6c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:32.830344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:32.834463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc142f0d-b04c-488d-9f8b-1145d33dc67d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:32.874748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799a39b-66cc-46f0-96d0-7c6af2604455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:32.875387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a39b-66cc-46f0-96d0-7c6af2604455 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.875665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a39b-66cc-46f0-96d0-7c6af2604455 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.875983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a39b-66cc-46f0-96d0-7c6af2604455 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.890418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799a39b-66cc-46f0-96d0-7c6af2604455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7799a39b-66cc-46f0-96d0-7c6af2604455 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:32.897571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:32.898665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 408/814] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:32.900679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799a39b-66cc-46f0-96d0-7c6af2604455 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:32.922465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bdd27-d867-4105-834a-301c42121c6c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:32.958031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad9157-aaa4-41ea-bb13-4b720ffa0598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:32.958630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad9157-aaa4-41ea-bb13-4b720ffa0598 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:32.958898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad9157-aaa4-41ea-bb13-4b720ffa0598 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:32.959256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad9157-aaa4-41ea-bb13-4b720ffa0598 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:32.959804 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad9157-aaa4-41ea-bb13-4b720ffa0598 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:32.961952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad9157-aaa4-41ea-bb13-4b720ffa0598 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:32.974866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:33.011799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799a39b-66cc-46f0-96d0-7c6af2604455 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:33.046936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5575c9-783b-4c58-980d-25e1576951c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:33.047499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5575c9-783b-4c58-980d-25e1576951c5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:33.047774 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5575c9-783b-4c58-980d-25e1576951c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:33.048045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5575c9-783b-4c58-980d-25e1576951c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:33.048744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5575c9-783b-4c58-980d-25e1576951c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:33.049031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5575c9-783b-4c58-980d-25e1576951c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:33.050474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5575c9-783b-4c58-980d-25e1576951c5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:33.062187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 409/815] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:33.062763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5575c9-783b-4c58-980d-25e1576951c5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:33.074965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 407/816] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:06:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:33.083362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:33.083565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad9157-aaa4-41ea-bb13-4b720ffa0598 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:33.182085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5575c9-783b-4c58-980d-25e1576951c5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:33.235254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d44235-3169-4cf3-b2e8-05b9140e44dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:33.235908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d44235-3169-4cf3-b2e8-05b9140e44dd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:33.236180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d44235-3169-4cf3-b2e8-05b9140e44dd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:33.236456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d44235-3169-4cf3-b2e8-05b9140e44dd None admin] PATH_INFO: `/v3/services/network` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:33.237041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d44235-3169-4cf3-b2e8-05b9140e44dd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:33.238462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d44235-3169-4cf3-b2e8-05b9140e44dd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:33.244760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad9157-aaa4-41ea-bb13-4b720ffa0598 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-45d44235-3169-4cf3-b2e8-05b9140e44dd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:33.251195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:33.252419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:33.253537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 410/817] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:33 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:33.254520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d44235-3169-4cf3-b2e8-05b9140e44dd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:33.296669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8728e-ab84-4b53-a6c8-ab7a0f054f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:33.297206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8728e-ab84-4b53-a6c8-ab7a0f054f4e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:33.297525 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8728e-ab84-4b53-a6c8-ab7a0f054f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:33.297800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8728e-ab84-4b53-a6c8-ab7a0f054f4e None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:33.298466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8728e-ab84-4b53-a6c8-ab7a0f054f4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:33.298991 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8728e-ab84-4b53-a6c8-ab7a0f054f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:33.300145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8728e-ab84-4b53-a6c8-ab7a0f054f4e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:33.310335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 408/818] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:33.313538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8728e-ab84-4b53-a6c8-ab7a0f054f4e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:33.367006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:33.379517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:33.392028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d44235-3169-4cf3-b2e8-05b9140e44dd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:33.423756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8728e-ab84-4b53-a6c8-ab7a0f054f4e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:33.428219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0e352-be41-4c58-927c-51bf0ef5a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:33.429116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0e352-be41-4c58-927c-51bf0ef5a81c None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:33.429623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0e352-be41-4c58-927c-51bf0ef5a81c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:33.430066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0e352-be41-4c58-927c-51bf0ef5a81c None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/6a2326353998441c938abf274b5e5dd4/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:33.437083 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0e352-be41-4c58-927c-51bf0ef5a81c None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=6a2326353998441c938abf274b5e5dd4, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:33.437083 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0e352-be41-4c58-927c-51bf0ef5a81c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:33.459109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a67a4-63a0-47bd-a0b1-93ca32a4be7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:33.459721 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a67a4-63a0-47bd-a0b1-93ca32a4be7d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:33.460081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a67a4-63a0-47bd-a0b1-93ca32a4be7d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:33.460269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a67a4-63a0-47bd-a0b1-93ca32a4be7d None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:33.461594 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a67a4-63a0-47bd-a0b1-93ca32a4be7d None admin] RBAC: Adding query filter params (name=network) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:33.461982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a67a4-63a0-47bd-a0b1-93ca32a4be7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:33.463358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a67a4-63a0-47bd-a0b1-93ca32a4be7d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:33.467975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 409/819] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:33.468754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a67a4-63a0-47bd-a0b1-93ca32a4be7d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:33.541644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 411/820] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:06:33 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/6a2326353998441c938abf274b5e5dd4/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:06:33.542845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0e352-be41-4c58-927c-51bf0ef5a81c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:33.589995 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a67a4-63a0-47bd-a0b1-93ca32a4be7d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:33.617769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:33.635313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d135d-0ccc-4632-86e9-9010a6446602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:33.635976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d135d-0ccc-4632-86e9-9010a6446602 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:33.636307 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d135d-0ccc-4632-86e9-9010a6446602 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:33.636584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d135d-0ccc-4632-86e9-9010a6446602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:33.650855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d135d-0ccc-4632-86e9-9010a6446602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:33.652831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d135d-0ccc-4632-86e9-9010a6446602 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-0c7d135d-0ccc-4632-86e9-9010a6446602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:33.670123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:33.671256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:33.672149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:33.672149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:33.672149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:33.672149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 410/821] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:33.683929 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d135d-0ccc-4632-86e9-9010a6446602 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:33.759926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0e352-be41-4c58-927c-51bf0ef5a81c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:33.797319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870631f1-66bb-4cb8-8e83-f30c8af0bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:33.798460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870631f1-66bb-4cb8-8e83-f30c8af0bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:33.799027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870631f1-66bb-4cb8-8e83-f30c8af0bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:33.799535 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870631f1-66bb-4cb8-8e83-f30c8af0bdf5 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:33.800402 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870631f1-66bb-4cb8-8e83-f30c8af0bdf5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:33.801009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870631f1-66bb-4cb8-8e83-f30c8af0bdf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:33.802732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870631f1-66bb-4cb8-8e83-f30c8af0bdf5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:33.808865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 412/822] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:33.815032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870631f1-66bb-4cb8-8e83-f30c8af0bdf5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:33.818029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:33.852827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d135d-0ccc-4632-86e9-9010a6446602 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:33.903890 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b363cf8-c356-4d6d-96c3-bce731202178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:33.904519 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b363cf8-c356-4d6d-96c3-bce731202178 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:33.904794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b363cf8-c356-4d6d-96c3-bce731202178 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:33.905063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b363cf8-c356-4d6d-96c3-bce731202178 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:33.905852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b363cf8-c356-4d6d-96c3-bce731202178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:33.906156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b363cf8-c356-4d6d-96c3-bce731202178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:33.907642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b363cf8-c356-4d6d-96c3-bce731202178 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:33.931097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870631f1-66bb-4cb8-8e83-f30c8af0bdf5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:33.934336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 411/823] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:33.939500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b363cf8-c356-4d6d-96c3-bce731202178 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:33.968297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fb1f9-20e1-4b2e-bab8-b45d4de96c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:33.969282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fb1f9-20e1-4b2e-bab8-b45d4de96c92 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:33.971342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fb1f9-20e1-4b2e-bab8-b45d4de96c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:33.971342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fb1f9-20e1-4b2e-bab8-b45d4de96c92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:33.971342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fb1f9-20e1-4b2e-bab8-b45d4de96c92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:33.972651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fb1f9-20e1-4b2e-bab8-b45d4de96c92 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:34.004177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:34.056860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 413/824] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:06:33 2022] POST /identity/v3/endpoints => generated 337 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:06:34.093082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b363cf8-c356-4d6d-96c3-bce731202178 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:34.140436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3716bc-080f-491f-a5b1-b5a20dc12218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:34.141567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3716bc-080f-491f-a5b1-b5a20dc12218 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:34.142058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3716bc-080f-491f-a5b1-b5a20dc12218 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:34.142563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3716bc-080f-491f-a5b1-b5a20dc12218 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:34.152472 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3716bc-080f-491f-a5b1-b5a20dc12218 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:34.154438 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3716bc-080f-491f-a5b1-b5a20dc12218 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-2c3716bc-080f-491f-a5b1-b5a20dc12218 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:34.168558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:34.169614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:34.170568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:34.170568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:34.170568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:34.170568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:34.170568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:34.170568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:34.170568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:34.170568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:34.170568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:06:34.170568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:34.172907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 412/825] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 17 16:06:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:34.178991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fb1f9-20e1-4b2e-bab8-b45d4de96c92 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:34.243308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:34.243511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc29f06-9068-4331-b99f-faca78287fdd None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:34.243731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc29f06-9068-4331-b99f-faca78287fdd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:34.244002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc29f06-9068-4331-b99f-faca78287fdd None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:34.246002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 413/826] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:34.256552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824c3eb-76af-42de-a732-d7eb8a29c966 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:34.256831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824c3eb-76af-42de-a732-d7eb8a29c966 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:34.257079 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824c3eb-76af-42de-a732-d7eb8a29c966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:34.293005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fb1f9-20e1-4b2e-bab8-b45d4de96c92 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:34.298513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8824c3eb-76af-42de-a732-d7eb8a29c966 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:34.299827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8824c3eb-76af-42de-a732-d7eb8a29c966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:34.351617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398ef8a-159c-46f5-a061-2f6dfa5aa466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:34.352716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398ef8a-159c-46f5-a061-2f6dfa5aa466 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:34.353008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398ef8a-159c-46f5-a061-2f6dfa5aa466 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:34.353284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398ef8a-159c-46f5-a061-2f6dfa5aa466 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:34.354168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398ef8a-159c-46f5-a061-2f6dfa5aa466 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:34.354468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398ef8a-159c-46f5-a061-2f6dfa5aa466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:34.356037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398ef8a-159c-46f5-a061-2f6dfa5aa466 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:34.381500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 414/827] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 17 16:06:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:34.388343 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398ef8a-159c-46f5-a061-2f6dfa5aa466 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:34.400639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 414/828] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:34.500874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398ef8a-159c-46f5-a061-2f6dfa5aa466 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:34.518767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:34.538138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d0f59-331c-4d6c-b685-98e14eb859d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:34.538852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0f59-331c-4d6c-b685-98e14eb859d5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:34.539143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0f59-331c-4d6c-b685-98e14eb859d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:34.539506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0f59-331c-4d6c-b685-98e14eb859d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:34.610378 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d0f59-331c-4d6c-b685-98e14eb859d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:34.611845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d0f59-331c-4d6c-b685-98e14eb859d5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:34.699577 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824c3eb-76af-42de-a732-d7eb8a29c966 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:34.716375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 415/829] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:34 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 16:06:34.722909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d0f59-331c-4d6c-b685-98e14eb859d5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:34.731717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:34.749714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:34.822504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824c3eb-76af-42de-a732-d7eb8a29c966 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:34.855001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d0f59-331c-4d6c-b685-98e14eb859d5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:34.860329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e99231-b82f-4ef8-8740-826107f70519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:34.860727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e99231-b82f-4ef8-8740-826107f70519 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:34.861061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e99231-b82f-4ef8-8740-826107f70519 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:34.861410 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e99231-b82f-4ef8-8740-826107f70519 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:34.872914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e99231-b82f-4ef8-8740-826107f70519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-28e99231-b82f-4ef8-8740-826107f70519 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:34.877712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:34.879547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:34.881786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:34.883606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 415/830] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:34.890013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e99231-b82f-4ef8-8740-826107f70519 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:34.896754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b0568-dfeb-439d-b6c2-1486933fa709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:34.897411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b0568-dfeb-439d-b6c2-1486933fa709 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:34.897696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b0568-dfeb-439d-b6c2-1486933fa709 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:34.897988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b0568-dfeb-439d-b6c2-1486933fa709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:34.915643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b0568-dfeb-439d-b6c2-1486933fa709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:34.917556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b0568-dfeb-439d-b6c2-1486933fa709 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-da1b0568-dfeb-439d-b6c2-1486933fa709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:34.938177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:34.939194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:34.940148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:34.940148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:34.940148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:34.944709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 416/831] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:34.945676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b0568-dfeb-439d-b6c2-1486933fa709 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:34.989702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:35.011335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e99231-b82f-4ef8-8740-826107f70519 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:35.033467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:35.050232 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619314b-4d62-4b92-a15c-0db5eccbe8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:35.051174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619314b-4d62-4b92-a15c-0db5eccbe8cb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.051694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619314b-4d62-4b92-a15c-0db5eccbe8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.052203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619314b-4d62-4b92-a15c-0db5eccbe8cb None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.053096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619314b-4d62-4b92-a15c-0db5eccbe8cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:35.053594 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619314b-4d62-4b92-a15c-0db5eccbe8cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:35.055436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619314b-4d62-4b92-a15c-0db5eccbe8cb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:35.071781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 416/832] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:35.072899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619314b-4d62-4b92-a15c-0db5eccbe8cb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:35.073719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b0568-dfeb-439d-b6c2-1486933fa709 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:35.110860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79aeb85-7ad3-42e8-b282-caae8dd4cb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:35.111877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aeb85-7ad3-42e8-b282-caae8dd4cb48 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.112392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aeb85-7ad3-42e8-b282-caae8dd4cb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.112840 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aeb85-7ad3-42e8-b282-caae8dd4cb48 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.113732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79aeb85-7ad3-42e8-b282-caae8dd4cb48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:35.114300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79aeb85-7ad3-42e8-b282-caae8dd4cb48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:35.115954 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79aeb85-7ad3-42e8-b282-caae8dd4cb48 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:35.129344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 417/833] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:35.135591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79aeb85-7ad3-42e8-b282-caae8dd4cb48 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:35.205614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619314b-4d62-4b92-a15c-0db5eccbe8cb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:35.252397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c559-b26a-46b2-9475-32f926596b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:35.253056 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c559-b26a-46b2-9475-32f926596b20 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.253423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c559-b26a-46b2-9475-32f926596b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.253762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c559-b26a-46b2-9475-32f926596b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.254258 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79aeb85-7ad3-42e8-b282-caae8dd4cb48 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:35.267662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7c559-b26a-46b2-9475-32f926596b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:35.269936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7c559-b26a-46b2-9475-32f926596b20 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:35.272543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:35.286498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-26c7c559-b26a-46b2-9475-32f926596b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:35.291417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:35.292352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:35.293248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:35.293248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:35.293248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:35.293248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 417/834] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:35.299127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c559-b26a-46b2-9475-32f926596b20 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:35.303116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55d16a-910d-486c-9311-cb0e2081f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:35.305251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55d16a-910d-486c-9311-cb0e2081f20c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.305550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55d16a-910d-486c-9311-cb0e2081f20c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.305827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55d16a-910d-486c-9311-cb0e2081f20c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.317750 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55d16a-910d-486c-9311-cb0e2081f20c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:35.320764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55d16a-910d-486c-9311-cb0e2081f20c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8c55d16a-910d-486c-9311-cb0e2081f20c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:35.334684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:35.335626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:35.336727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:35.336727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:35.336727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:35.336727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:35.336727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:35.336727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:35.336727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:35.336727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:35.338896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 418/835] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:35.340400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079773-6f4c-4f04-99da-492582d225d7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.340951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079773-6f4c-4f04-99da-492582d225d7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.341563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079773-6f4c-4f04-99da-492582d225d7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.343246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 419/836] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:35.347917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b079773-6f4c-4f04-99da-492582d225d7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:35.416222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c559-b26a-46b2-9475-32f926596b20 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:35.451032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b079773-6f4c-4f04-99da-492582d225d7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:35.454461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2072dd-b302-49a2-ba7f-224b806f0a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:35.455221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2072dd-b302-49a2-ba7f-224b806f0a4a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.455599 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2072dd-b302-49a2-ba7f-224b806f0a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.455967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2072dd-b302-49a2-ba7f-224b806f0a4a None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.456718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2072dd-b302-49a2-ba7f-224b806f0a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:35.457120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2072dd-b302-49a2-ba7f-224b806f0a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:35.458858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2072dd-b302-49a2-ba7f-224b806f0a4a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:35.476939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 418/837] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:35.476939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818052-da5b-4b91-aea7-9f4712e26b1c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.476939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818052-da5b-4b91-aea7-9f4712e26b1c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.476939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818052-da5b-4b91-aea7-9f4712e26b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.490962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57335777-c42c-4f73-a6b4-dbc0564bb534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:35.492175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335777-c42c-4f73-a6b4-dbc0564bb534 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.492541 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335777-c42c-4f73-a6b4-dbc0564bb534 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.492880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335777-c42c-4f73-a6b4-dbc0564bb534 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.493272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-50818052-da5b-4b91-aea7-9f4712e26b1c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:35.493755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57335777-c42c-4f73-a6b4-dbc0564bb534 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:35.494131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57335777-c42c-4f73-a6b4-dbc0564bb534 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:35.494697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-50818052-da5b-4b91-aea7-9f4712e26b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:35.495674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57335777-c42c-4f73-a6b4-dbc0564bb534 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:35.508976 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 420/838] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:35.509827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57335777-c42c-4f73-a6b4-dbc0564bb534 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:35.552542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:35.560687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:35.571408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 419/839] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:35.578285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50818052-da5b-4b91-aea7-9f4712e26b1c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:35.623950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57335777-c42c-4f73-a6b4-dbc0564bb534 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:35.662369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01e247-ee0e-44e1-8e30-a463106fdcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:35.663370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01e247-ee0e-44e1-8e30-a463106fdcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.664572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01e247-ee0e-44e1-8e30-a463106fdcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.665164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01e247-ee0e-44e1-8e30-a463106fdcd4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.673804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01e247-ee0e-44e1-8e30-a463106fdcd4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:35.675797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01e247-ee0e-44e1-8e30-a463106fdcd4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:35.684406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50818052-da5b-4b91-aea7-9f4712e26b1c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9b01e247-ee0e-44e1-8e30-a463106fdcd4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:35.688482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:35.689449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:35.690443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:35.690443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:35.690443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:35.690443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:35.690443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:35.690443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:35.690443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:35.690443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:35.690443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:35.690443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:35.693324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 421/840] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 17 16:06:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:35.699137 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01e247-ee0e-44e1-8e30-a463106fdcd4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:35.733912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340010f-5304-41d3-b802-b818449f1e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:35.735201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340010f-5304-41d3-b802-b818449f1e41 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.735661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340010f-5304-41d3-b802-b818449f1e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.736127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340010f-5304-41d3-b802-b818449f1e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.736991 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340010f-5304-41d3-b802-b818449f1e41 None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=f99edbaee8504487863c6fa4b551c224) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:35.737463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340010f-5304-41d3-b802-b818449f1e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:35.739028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340010f-5304-41d3-b802-b818449f1e41 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:35.746292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 420/841] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:35 2022] GET /identity/v3/role_assignments?user.id=f99edbaee8504487863c6fa4b551c224&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=28beda93f70d4c549352145ddee01aac => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:35.787288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b4a1f-49de-453f-a571-74973edd095c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.787530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b4a1f-49de-453f-a571-74973edd095c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.787760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b4a1f-49de-453f-a571-74973edd095c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.794602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 421/842] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:06:35.796007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130efc16-6a87-4fb6-a157-03c57f1457cd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.796292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130efc16-6a87-4fb6-a157-03c57f1457cd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.796566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130efc16-6a87-4fb6-a157-03c57f1457cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.816522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-130efc16-6a87-4fb6-a157-03c57f1457cd None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:35.817793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-130efc16-6a87-4fb6-a157-03c57f1457cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:35.829540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01e247-ee0e-44e1-8e30-a463106fdcd4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:35.840376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:35.868439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ff204-bbdd-4128-9161-d858be721b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:35.869064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ff204-bbdd-4128-9161-d858be721b37 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:35.869343 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ff204-bbdd-4128-9161-d858be721b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:35.869647 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ff204-bbdd-4128-9161-d858be721b37 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:35.870391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ff204-bbdd-4128-9161-d858be721b37 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:35.870688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ff204-bbdd-4128-9161-d858be721b37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:35.872230 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ff204-bbdd-4128-9161-d858be721b37 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:35.874484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:35.897956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 422/843] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 17 16:06:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:35.897956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ff204-bbdd-4128-9161-d858be721b37 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:35.909021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 422/844] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:35.910804 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130efc16-6a87-4fb6-a157-03c57f1457cd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:36.025717 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ff204-bbdd-4128-9161-d858be721b37 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:36.042514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130efc16-6a87-4fb6-a157-03c57f1457cd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:36.070970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b7716-f963-49d1-92c7-43f8368968a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:36.072420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b7716-f963-49d1-92c7-43f8368968a1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:36.073115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b7716-f963-49d1-92c7-43f8368968a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:36.073567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b7716-f963-49d1-92c7-43f8368968a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:36.074575 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b7716-f963-49d1-92c7-43f8368968a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:36.076880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b7716-f963-49d1-92c7-43f8368968a1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:36.086914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a571b-b9c6-4f71-8f6b-9e1ca99d45f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:36.087609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a571b-b9c6-4f71-8f6b-9e1ca99d45f4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:36.087960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a571b-b9c6-4f71-8f6b-9e1ca99d45f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:36.088300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a571b-b9c6-4f71-8f6b-9e1ca99d45f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c71b7716-f963-49d1-92c7-43f8368968a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:36.089736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:36.090910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:06:36.091974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:36.100709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 423/845] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:06:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:36.102781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b7716-f963-49d1-92c7-43f8368968a1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:36.136392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:36.157664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:36.188382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a571b-b9c6-4f71-8f6b-9e1ca99d45f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:36.190424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a571b-b9c6-4f71-8f6b-9e1ca99d45f4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:36.213294 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b7716-f963-49d1-92c7-43f8368968a1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:36.254495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbded83f-92c4-45e6-9405-234657ca97cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:36.255106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbded83f-92c4-45e6-9405-234657ca97cd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:36.255381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbded83f-92c4-45e6-9405-234657ca97cd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:36.255822 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbded83f-92c4-45e6-9405-234657ca97cd None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:36.256898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbded83f-92c4-45e6-9405-234657ca97cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:36.257251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbded83f-92c4-45e6-9405-234657ca97cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:36.258767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbded83f-92c4-45e6-9405-234657ca97cd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:36.267888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 424/846] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:06:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:36.267888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbded83f-92c4-45e6-9405-234657ca97cd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:36.297412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 423/847] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:06:36.298147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a571b-b9c6-4f71-8f6b-9e1ca99d45f4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:36.379599 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:36.381173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:36.388716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbded83f-92c4-45e6-9405-234657ca97cd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:36.403091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a571b-b9c6-4f71-8f6b-9e1ca99d45f4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:36.433573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c992098-1faf-447c-a818-6f0034eb9d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:36.435291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c992098-1faf-447c-a818-6f0034eb9d27 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:36.435722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c992098-1faf-447c-a818-6f0034eb9d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:36.436191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c992098-1faf-447c-a818-6f0034eb9d27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:36.438872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42483671-d956-40ca-82cd-034889148006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:36.439850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483671-d956-40ca-82cd-034889148006 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:36.440219 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483671-d956-40ca-82cd-034889148006 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:36.440583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483671-d956-40ca-82cd-034889148006 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:36.441312 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42483671-d956-40ca-82cd-034889148006 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:36.441732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42483671-d956-40ca-82cd-034889148006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:36.443451 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42483671-d956-40ca-82cd-034889148006 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:36.448242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c992098-1faf-447c-a818-6f0034eb9d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:36.448999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 424/848] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:06:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:36.449859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42483671-d956-40ca-82cd-034889148006 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5c992098-1faf-447c-a818-6f0034eb9d27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:36.464418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:36.466008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:36.467074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:36.474595 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 425/849] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:36.478630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c992098-1faf-447c-a818-6f0034eb9d27 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:36.580131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42483671-d956-40ca-82cd-034889148006 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:36.622513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234eb5d2-d080-44e2-888b-f2324ecde9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:36.623456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234eb5d2-d080-44e2-888b-f2324ecde9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:36.623824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234eb5d2-d080-44e2-888b-f2324ecde9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:36.624499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234eb5d2-d080-44e2-888b-f2324ecde9f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:36.629888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c992098-1faf-447c-a818-6f0034eb9d27 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:36.639824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234eb5d2-d080-44e2-888b-f2324ecde9f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:36.641847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234eb5d2-d080-44e2-888b-f2324ecde9f6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:36.644458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-234eb5d2-d080-44e2-888b-f2324ecde9f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:36.663306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:36.665750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:36.666752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:36.666752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:36.666752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:36.669787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0785-2183-4e96-9e93-e64f1bcebd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:36.670397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0785-2183-4e96-9e93-e64f1bcebd5a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:36.670672 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0785-2183-4e96-9e93-e64f1bcebd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:36.671162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 425/850] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:36.671298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0785-2183-4e96-9e93-e64f1bcebd5a None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:36.671907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f0785-2183-4e96-9e93-e64f1bcebd5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:36.672275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f0785-2183-4e96-9e93-e64f1bcebd5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:36.672646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234eb5d2-d080-44e2-888b-f2324ecde9f6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:36.673939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f0785-2183-4e96-9e93-e64f1bcebd5a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:36.683305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 426/851] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:36.688794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0785-2183-4e96-9e93-e64f1bcebd5a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:36.710996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:36.792549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234eb5d2-d080-44e2-888b-f2324ecde9f6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:36.796672 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0785-2183-4e96-9e93-e64f1bcebd5a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:36.830864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289073e7-d5b1-405e-a942-0723b3c170fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:36.831384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289073e7-d5b1-405e-a942-0723b3c170fb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:36.831655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289073e7-d5b1-405e-a942-0723b3c170fb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:36.831917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289073e7-d5b1-405e-a942-0723b3c170fb None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:36.832546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289073e7-d5b1-405e-a942-0723b3c170fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:36.832842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289073e7-d5b1-405e-a942-0723b3c170fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:36.833960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cad83-ce28-4579-aa8f-dcc5634ca56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:36.834220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289073e7-d5b1-405e-a942-0723b3c170fb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:36.834774 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cad83-ce28-4579-aa8f-dcc5634ca56d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:36.835155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cad83-ce28-4579-aa8f-dcc5634ca56d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:36.835682 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cad83-ce28-4579-aa8f-dcc5634ca56d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:36.846930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cad83-ce28-4579-aa8f-dcc5634ca56d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:36.848533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cad83-ce28-4579-aa8f-dcc5634ca56d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:36.851520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 426/852] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:36.852863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289073e7-d5b1-405e-a942-0723b3c170fb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e17cad83-ce28-4579-aa8f-dcc5634ca56d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:36.865549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:36.868674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:36.870802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:36.870802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:36.870802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:36.870802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 427/853] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:36.878704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cad83-ce28-4579-aa8f-dcc5634ca56d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:36.919713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:36.972060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289073e7-d5b1-405e-a942-0723b3c170fb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:36.977010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:37.013255 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eac92b-6eb9-4aa3-9405-11c75e8c57f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:37.013923 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eac92b-6eb9-4aa3-9405-11c75e8c57f7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:37.014197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eac92b-6eb9-4aa3-9405-11c75e8c57f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:37.014462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eac92b-6eb9-4aa3-9405-11c75e8c57f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:37.025741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eac92b-6eb9-4aa3-9405-11c75e8c57f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:37.027175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eac92b-6eb9-4aa3-9405-11c75e8c57f7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:37.030559 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cad83-ce28-4579-aa8f-dcc5634ca56d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b9eac92b-6eb9-4aa3-9405-11c75e8c57f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:37.039024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:37.039946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:37.040813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:37.040813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:37.040813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:37.040813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:37.040813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:37.040813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:37.040813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:37.040813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:37.044931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 427/854] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:37.045790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eac92b-6eb9-4aa3-9405-11c75e8c57f7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:37.079310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6945bfe-a7e5-4aff-95e1-ead9a4064a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:37.081060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6945bfe-a7e5-4aff-95e1-ead9a4064a97 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:37.081279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6945bfe-a7e5-4aff-95e1-ead9a4064a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:37.082315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6945bfe-a7e5-4aff-95e1-ead9a4064a97 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:37.082930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6945bfe-a7e5-4aff-95e1-ead9a4064a97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:37.083233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6945bfe-a7e5-4aff-95e1-ead9a4064a97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:37.085239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6945bfe-a7e5-4aff-95e1-ead9a4064a97 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:37.103371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 428/855] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:37.104280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6945bfe-a7e5-4aff-95e1-ead9a4064a97 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:37.177526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eac92b-6eb9-4aa3-9405-11c75e8c57f7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:37.198629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:37.211210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6945bfe-a7e5-4aff-95e1-ead9a4064a97 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:37.224750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c5c24-09d6-4f93-8ba9-34ade98c0b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:37.225712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c5c24-09d6-4f93-8ba9-34ade98c0b26 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:37.227139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c5c24-09d6-4f93-8ba9-34ade98c0b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:37.227499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c5c24-09d6-4f93-8ba9-34ade98c0b26 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:37.228527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c5c24-09d6-4f93-8ba9-34ade98c0b26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:37.228899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c5c24-09d6-4f93-8ba9-34ade98c0b26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:37.231040 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c5c24-09d6-4f93-8ba9-34ade98c0b26 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:37.242208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:37.249509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 428/856] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:37.251314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32657987-6e0a-4e7c-988d-cec10509fa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:37.252204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32657987-6e0a-4e7c-988d-cec10509fa27 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:37.252640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32657987-6e0a-4e7c-988d-cec10509fa27 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:37.253069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32657987-6e0a-4e7c-988d-cec10509fa27 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:37.255313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c5c24-09d6-4f93-8ba9-34ade98c0b26 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:37.263377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32657987-6e0a-4e7c-988d-cec10509fa27 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:37.264895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32657987-6e0a-4e7c-988d-cec10509fa27 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-32657987-6e0a-4e7c-988d-cec10509fa27 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:37.280866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:37.281919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:37.282838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:37.282838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:37.282838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:37.282838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:37.282838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:37.282838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:37.282838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:37.282838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:37.282838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:06:37.282838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:37.282838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 429/857] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:37.290194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32657987-6e0a-4e7c-988d-cec10509fa27 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:37.369552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c5c24-09d6-4f93-8ba9-34ade98c0b26 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:37.399434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32657987-6e0a-4e7c-988d-cec10509fa27 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:37.406405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0095d-b845-4b85-b938-ad423b213067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:37.407058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0095d-b845-4b85-b938-ad423b213067 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:37.407325 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0095d-b845-4b85-b938-ad423b213067 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:37.407590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0095d-b845-4b85-b938-ad423b213067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:37.408354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0095d-b845-4b85-b938-ad423b213067 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=666d255c72394f4e9faaeb5b94253cf1) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:37.408658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0095d-b845-4b85-b938-ad423b213067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:37.410108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0095d-b845-4b85-b938-ad423b213067 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:37.425394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 429/858] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:37 2022] GET /identity/v3/role_assignments?user.id=666d255c72394f4e9faaeb5b94253cf1&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:37.449894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e00ab-31b9-470b-bfd9-e9c7eddd1d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:37.450520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e00ab-31b9-470b-bfd9-e9c7eddd1d72 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:37.450791 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e00ab-31b9-470b-bfd9-e9c7eddd1d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:37.451057 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e00ab-31b9-470b-bfd9-e9c7eddd1d72 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:37.451942 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e00ab-31b9-470b-bfd9-e9c7eddd1d72 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:37.452245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e00ab-31b9-470b-bfd9-e9c7eddd1d72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:37.453731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e00ab-31b9-470b-bfd9-e9c7eddd1d72 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:37.474365 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 430/859] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 17 16:06:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:37.481216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0095d-b845-4b85-b938-ad423b213067 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:37.527425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:37.595881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0095d-b845-4b85-b938-ad423b213067 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:37.632124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c56d1-daf7-4e89-ad9a-3d3ac5a635f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:37.632692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c56d1-daf7-4e89-ad9a-3d3ac5a635f6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:37.632962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c56d1-daf7-4e89-ad9a-3d3ac5a635f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:37.633226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c56d1-daf7-4e89-ad9a-3d3ac5a635f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:37.703917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c56d1-daf7-4e89-ad9a-3d3ac5a635f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:37.705356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c56d1-daf7-4e89-ad9a-3d3ac5a635f6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:37.745740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:37.785576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0ac80-bcf2-450b-b5b9-2372a5e1abbc None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:37.785860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0ac80-bcf2-450b-b5b9-2372a5e1abbc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:37.786138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0ac80-bcf2-450b-b5b9-2372a5e1abbc None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:37.787697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 431/860] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:37.793838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad6316-a871-4ec7-8cdc-07a896e4ca8b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:37.794121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad6316-a871-4ec7-8cdc-07a896e4ca8b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:37.794402 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad6316-a871-4ec7-8cdc-07a896e4ca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:37.812305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-71ad6316-a871-4ec7-8cdc-07a896e4ca8b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:37.813531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-71ad6316-a871-4ec7-8cdc-07a896e4ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:37.814440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 430/861] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:06:37.821242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c56d1-daf7-4e89-ad9a-3d3ac5a635f6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:37.865743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:37.888710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 432/862] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:37.927065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c56d1-daf7-4e89-ad9a-3d3ac5a635f6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:37.962769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ce5eb-b73e-4a93-9c85-32fb0b24dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:37.963411 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ce5eb-b73e-4a93-9c85-32fb0b24dc36 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:37.963688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ce5eb-b73e-4a93-9c85-32fb0b24dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:37.963957 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ce5eb-b73e-4a93-9c85-32fb0b24dc36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:37.971215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:37.975293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ce5eb-b73e-4a93-9c85-32fb0b24dc36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:37.976884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ce5eb-b73e-4a93-9c85-32fb0b24dc36 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-bc8ce5eb-b73e-4a93-9c85-32fb0b24dc36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:37.991365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:37.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:37.993801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:37.993801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:37.993801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:37.993801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 431/863] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:38.002513 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad6316-a871-4ec7-8cdc-07a896e4ca8b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:38.114018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad6316-a871-4ec7-8cdc-07a896e4ca8b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:38.154516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dbe22-c5a0-48ad-bb2b-2a763eee706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:38.155042 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dbe22-c5a0-48ad-bb2b-2a763eee706b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:38.155314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dbe22-c5a0-48ad-bb2b-2a763eee706b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:38.155582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dbe22-c5a0-48ad-bb2b-2a763eee706b None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:38.156219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dbe22-c5a0-48ad-bb2b-2a763eee706b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:38.156512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dbe22-c5a0-48ad-bb2b-2a763eee706b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:38.157953 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dbe22-c5a0-48ad-bb2b-2a763eee706b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:38.169803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 433/864] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:38.175531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ce5eb-b73e-4a93-9c85-32fb0b24dc36 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:38.182491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dbe22-c5a0-48ad-bb2b-2a763eee706b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:38.221564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:38.283482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ce5eb-b73e-4a93-9c85-32fb0b24dc36 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:38.293305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dbe22-c5a0-48ad-bb2b-2a763eee706b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:38.319351 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9912e91-a82d-4dd3-b31e-34c7f4680dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:38.321021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9912e91-a82d-4dd3-b31e-34c7f4680dbb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:38.321556 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9912e91-a82d-4dd3-b31e-34c7f4680dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:38.322029 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9912e91-a82d-4dd3-b31e-34c7f4680dbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:38.329531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9912e91-a82d-4dd3-b31e-34c7f4680dbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:38.330933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee46dfd-6c85-4b8e-af72-ff16108c972a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:38.331561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee46dfd-6c85-4b8e-af72-ff16108c972a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:38.331833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee46dfd-6c85-4b8e-af72-ff16108c972a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:38.332054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9912e91-a82d-4dd3-b31e-34c7f4680dbb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:38.332155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee46dfd-6c85-4b8e-af72-ff16108c972a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:38.332723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee46dfd-6c85-4b8e-af72-ff16108c972a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:38.334239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee46dfd-6c85-4b8e-af72-ff16108c972a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2ee46dfd-6c85-4b8e-af72-ff16108c972a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:38.343623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:38.344564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:06:38.345484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a9912e91-a82d-4dd3-b31e-34c7f4680dbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:38.347420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:38.348260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:38.349155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:38.349155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:38.349155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:38.349155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:38.349155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:38.349155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:38.349155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:38.349155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:38.350023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 434/865] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 17 16:06:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:38.350762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee46dfd-6c85-4b8e-af72-ff16108c972a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:38.352349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 432/866] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:38.357978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9912e91-a82d-4dd3-b31e-34c7f4680dbb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:38.412036 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:38.457823 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:38.462255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee46dfd-6c85-4b8e-af72-ff16108c972a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:38.465615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9912e91-a82d-4dd3-b31e-34c7f4680dbb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:38.500375 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4eb492-2626-4b27-93b1-f500457fab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:38.500602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a636a8-34a7-4761-a4bc-fcbfc35b7b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:38.501032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eb492-2626-4b27-93b1-f500457fab17 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:38.501268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a636a8-34a7-4761-a4bc-fcbfc35b7b8a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:38.501401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eb492-2626-4b27-93b1-f500457fab17 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:38.501558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eb492-2626-4b27-93b1-f500457fab17 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:38.501651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a636a8-34a7-4761-a4bc-fcbfc35b7b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:38.501795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a636a8-34a7-4761-a4bc-fcbfc35b7b8a None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:38.502216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4eb492-2626-4b27-93b1-f500457fab17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:38.502421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a636a8-34a7-4761-a4bc-fcbfc35b7b8a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:38.502515 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4eb492-2626-4b27-93b1-f500457fab17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:38.502720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a636a8-34a7-4761-a4bc-fcbfc35b7b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:38.503931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4eb492-2626-4b27-93b1-f500457fab17 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:38.504198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a636a8-34a7-4761-a4bc-fcbfc35b7b8a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:38.513973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 435/867] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 17 16:06:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:38.513973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980c40-6de8-4384-85e7-b4d5aee0ec4f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:38.513973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980c40-6de8-4384-85e7-b4d5aee0ec4f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:38.513973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980c40-6de8-4384-85e7-b4d5aee0ec4f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:38.513973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 436/868] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:38.515011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980c40-6de8-4384-85e7-b4d5aee0ec4f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:38.521299 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 433/869] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:38.522554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443970d-665c-4117-880f-84553d82dadc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:38.522870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443970d-665c-4117-880f-84553d82dadc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:38.523150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443970d-665c-4117-880f-84553d82dadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:38.541562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5443970d-665c-4117-880f-84553d82dadc None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:38.542759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5443970d-665c-4117-880f-84553d82dadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:38.618940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 434/870] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:38.620162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443970d-665c-4117-880f-84553d82dadc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:38.639789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980c40-6de8-4384-85e7-b4d5aee0ec4f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:38.665310 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:38.688829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f922e-2bd7-4ce6-86ea-1be5a8b2f1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:38.690204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f922e-2bd7-4ce6-86ea-1be5a8b2f1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:38.690485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f922e-2bd7-4ce6-86ea-1be5a8b2f1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:38.690755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f922e-2bd7-4ce6-86ea-1be5a8b2f1e7 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:38.691390 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f922e-2bd7-4ce6-86ea-1be5a8b2f1e7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:38.691692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f922e-2bd7-4ce6-86ea-1be5a8b2f1e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:38.693334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f922e-2bd7-4ce6-86ea-1be5a8b2f1e7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:38.703686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 437/871] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 17 16:06:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:38.738374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443970d-665c-4117-880f-84553d82dadc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:38.779347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328bfed-bc4e-4b6f-9c1b-9e325742d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:38.780365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328bfed-bc4e-4b6f-9c1b-9e325742d267 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:38.780909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328bfed-bc4e-4b6f-9c1b-9e325742d267 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:38.781404 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328bfed-bc4e-4b6f-9c1b-9e325742d267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:38.782366 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328bfed-bc4e-4b6f-9c1b-9e325742d267 None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=6a2326353998441c938abf274b5e5dd4) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:38.782886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328bfed-bc4e-4b6f-9c1b-9e325742d267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:38.784585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328bfed-bc4e-4b6f-9c1b-9e325742d267 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:38.792645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 435/872] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:38 2022] GET /identity/v3/role_assignments?user.id=6a2326353998441c938abf274b5e5dd4&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=28beda93f70d4c549352145ddee01aac => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:38.893315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f922e-2bd7-4ce6-86ea-1be5a8b2f1e7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:38.932608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:39.010184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f922e-2bd7-4ce6-86ea-1be5a8b2f1e7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:39.047451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd589-464d-42b2-9148-2e61ede5b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:39.048473 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd589-464d-42b2-9148-2e61ede5b914 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:39.048983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd589-464d-42b2-9148-2e61ede5b914 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:39.049496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd589-464d-42b2-9148-2e61ede5b914 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:39.050377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd589-464d-42b2-9148-2e61ede5b914 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:39.052036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd589-464d-42b2-9148-2e61ede5b914 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:39.119503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 438/873] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:06:38 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:39.547413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11095e-e67d-4921-b6d8-dfdf3854ae80 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:39.547936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11095e-e67d-4921-b6d8-dfdf3854ae80 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:39.547936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11095e-e67d-4921-b6d8-dfdf3854ae80 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:39.549596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 436/874] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:39.555058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c83d3-5ccc-4702-9325-a98b17659fa0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:39.555478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c83d3-5ccc-4702-9325-a98b17659fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:39.555652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c83d3-5ccc-4702-9325-a98b17659fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:39.574516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1d2c83d3-5ccc-4702-9325-a98b17659fa0 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:39.575700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1d2c83d3-5ccc-4702-9325-a98b17659fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:39.655391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 439/875] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:39.941515 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11095e-e67d-4921-b6d8-dfdf3854ae80 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:40.057031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11095e-e67d-4921-b6d8-dfdf3854ae80 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:40.059491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:40.092570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7f5c8-aa2f-472d-98f8-131797de879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:40.093197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f5c8-aa2f-472d-98f8-131797de879f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:40.093500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f5c8-aa2f-472d-98f8-131797de879f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:40.093768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f5c8-aa2f-472d-98f8-131797de879f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:40.104768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7f5c8-aa2f-472d-98f8-131797de879f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-99f7f5c8-aa2f-472d-98f8-131797de879f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:40.109394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:40.110315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:40.111178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 437/876] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 17 16:06:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:40.116461 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c83d3-5ccc-4702-9325-a98b17659fa0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:40.132499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:40.222979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c83d3-5ccc-4702-9325-a98b17659fa0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:40.259315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da40b7-ee1a-40e2-b414-068bad44f137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:40.259928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da40b7-ee1a-40e2-b414-068bad44f137 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:40.260204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da40b7-ee1a-40e2-b414-068bad44f137 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:40.260474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da40b7-ee1a-40e2-b414-068bad44f137 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:40.261142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da40b7-ee1a-40e2-b414-068bad44f137 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:40.261469 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da40b7-ee1a-40e2-b414-068bad44f137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:40.262855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da40b7-ee1a-40e2-b414-068bad44f137 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:40.271858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 440/877] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 17 16:06:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:40.277919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7f5c8-aa2f-472d-98f8-131797de879f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:40.386494 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7f5c8-aa2f-472d-98f8-131797de879f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:40.422018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498d9ee-6b11-4586-ba96-1b97286bd5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:40.422651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498d9ee-6b11-4586-ba96-1b97286bd5fe None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:40.422925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498d9ee-6b11-4586-ba96-1b97286bd5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:40.423193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498d9ee-6b11-4586-ba96-1b97286bd5fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:40.435582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498d9ee-6b11-4586-ba96-1b97286bd5fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:40.437043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498d9ee-6b11-4586-ba96-1b97286bd5fe None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-4498d9ee-6b11-4586-ba96-1b97286bd5fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:40.451949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:40.454274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:40.456561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:40.456561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:40.456561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:40.456561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 438/878] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:40.458901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da40b7-ee1a-40e2-b414-068bad44f137 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:40.540706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:40.564174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da40b7-ee1a-40e2-b414-068bad44f137 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:40.600224 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0d80b-dd79-4498-a6c3-27a5f4a8bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:40.601409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0d80b-dd79-4498-a6c3-27a5f4a8bd64 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:40.601888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0d80b-dd79-4498-a6c3-27a5f4a8bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:40.602148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0d80b-dd79-4498-a6c3-27a5f4a8bd64 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:40.602788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0d80b-dd79-4498-a6c3-27a5f4a8bd64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:40.603086 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0d80b-dd79-4498-a6c3-27a5f4a8bd64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:40.604448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0d80b-dd79-4498-a6c3-27a5f4a8bd64 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:40.616682 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 441/879] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:40.618963 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd40b70-d71a-42b7-a1c6-a4e23735b8e6 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:40.619487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd40b70-d71a-42b7-a1c6-a4e23735b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:40.619487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd40b70-d71a-42b7-a1c6-a4e23735b8e6 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:40.622614 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0d80b-dd79-4498-a6c3-27a5f4a8bd64 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:40.623045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 439/880] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:40.625942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9ade5-3a76-4b31-a552-d322b4023837 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:40.626217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9ade5-3a76-4b31-a552-d322b4023837 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:40.626487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9ade5-3a76-4b31-a552-d322b4023837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:40.644697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1ee9ade5-3a76-4b31-a552-d322b4023837 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:40.646053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1ee9ade5-3a76-4b31-a552-d322b4023837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:40.658678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:40.730725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0d80b-dd79-4498-a6c3-27a5f4a8bd64 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:40.741518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 440/881] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:40.768074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b1749-47a8-4b29-998a-929af1e5fcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:40.768714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b1749-47a8-4b29-998a-929af1e5fcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:40.768987 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b1749-47a8-4b29-998a-929af1e5fcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:40.769260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b1749-47a8-4b29-998a-929af1e5fcd3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:40.773517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:40.787686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b1749-47a8-4b29-998a-929af1e5fcd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:40.790084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b1749-47a8-4b29-998a-929af1e5fcd3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-896b1749-47a8-4b29-998a-929af1e5fcd3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:40.801905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:40.803015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:40.804443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:40.804443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:40.804443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:40.804443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:40.804443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:40.804443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:40.804443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:40.804443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:40.804443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:40.804443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:40.806534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 442/882] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 17 16:06:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:40.817416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9ade5-3a76-4b31-a552-d322b4023837 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:40.921648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e9ad-d7cc-4e8b-90b1-c1340ed1daa9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:40.921938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e9ad-d7cc-4e8b-90b1-c1340ed1daa9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:40.922185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e9ad-d7cc-4e8b-90b1-c1340ed1daa9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:40.923764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 443/883] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:06:40.924279 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9ade5-3a76-4b31-a552-d322b4023837 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:40.928657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809df958-3d54-4d5e-9020-8f00dd470a54 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:40.929062 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809df958-3d54-4d5e-9020-8f00dd470a54 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:40.929343 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809df958-3d54-4d5e-9020-8f00dd470a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:40.961062 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-809df958-3d54-4d5e-9020-8f00dd470a54 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:40.963259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-809df958-3d54-4d5e-9020-8f00dd470a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:40.967535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fd501-905b-4f86-8277-7a1645f9f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:40.968143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fd501-905b-4f86-8277-7a1645f9f716 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:40.968419 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fd501-905b-4f86-8277-7a1645f9f716 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:40.968679 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fd501-905b-4f86-8277-7a1645f9f716 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:40.969493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fd501-905b-4f86-8277-7a1645f9f716 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:40.969794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fd501-905b-4f86-8277-7a1645f9f716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:40.971259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fd501-905b-4f86-8277-7a1645f9f716 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:40.995229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 441/884] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 17 16:06:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:40.996659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fd501-905b-4f86-8277-7a1645f9f716 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:41.001186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:41.060436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 444/885] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:41.061571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809df958-3d54-4d5e-9020-8f00dd470a54 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:41.124402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fd501-905b-4f86-8277-7a1645f9f716 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:41.170228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809df958-3d54-4d5e-9020-8f00dd470a54 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:41.175499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099a7ab-9a63-4522-a95a-c369acde8778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:41.176396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099a7ab-9a63-4522-a95a-c369acde8778 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:41.176867 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099a7ab-9a63-4522-a95a-c369acde8778 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:41.177336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099a7ab-9a63-4522-a95a-c369acde8778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:41.198486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:41.207657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab2263-3237-481b-bb8a-589de3a050b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:41.210999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab2263-3237-481b-bb8a-589de3a050b0 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:41.210999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab2263-3237-481b-bb8a-589de3a050b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:41.210999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab2263-3237-481b-bb8a-589de3a050b0 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:41.210999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab2263-3237-481b-bb8a-589de3a050b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:41.212798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab2263-3237-481b-bb8a-589de3a050b0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:41.250039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099a7ab-9a63-4522-a95a-c369acde8778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:41.251466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099a7ab-9a63-4522-a95a-c369acde8778 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:41.254870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:41.312748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 445/886] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:06:41 2022] POST /identity/v3/services => generated 269 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:41.314383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d22e5c-e1c6-4942-80c4-6dd4acb96d20 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:41.314734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d22e5c-e1c6-4942-80c4-6dd4acb96d20 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:41.315082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d22e5c-e1c6-4942-80c4-6dd4acb96d20 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:41.316624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 446/887] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:41.323134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d74388-3ed1-44cd-be9f-4ae0099c00f9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:41.323442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d74388-3ed1-44cd-be9f-4ae0099c00f9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:41.323868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d74388-3ed1-44cd-be9f-4ae0099c00f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:41.348281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f9d74388-3ed1-44cd-be9f-4ae0099c00f9 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:41.349547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f9d74388-3ed1-44cd-be9f-4ae0099c00f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:41.361918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 442/888] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:40 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:06:41.362633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099a7ab-9a63-4522-a95a-c369acde8778 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:41.435092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 447/889] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:41.436031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d74388-3ed1-44cd-be9f-4ae0099c00f9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:41.488074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099a7ab-9a63-4522-a95a-c369acde8778 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:41.493309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:41.543142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8207e-5ccc-4561-8605-ff24b464751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:41.544052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8207e-5ccc-4561-8605-ff24b464751f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:41.544424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8207e-5ccc-4561-8605-ff24b464751f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:41.544921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8207e-5ccc-4561-8605-ff24b464751f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:41.546083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8207e-5ccc-4561-8605-ff24b464751f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:41.547936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8207e-5ccc-4561-8605-ff24b464751f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:41.554360 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d74388-3ed1-44cd-be9f-4ae0099c00f9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-22c8207e-5ccc-4561-8605-ff24b464751f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:41.560164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:41.561202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:41.562127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 443/890] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 17 16:06:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:41.569166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8207e-5ccc-4561-8605-ff24b464751f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:41.585750 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:41.604575 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb223-14c8-44b7-b8ad-5b4a5494919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:41.605886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb223-14c8-44b7-b8ad-5b4a5494919b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:41.606406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb223-14c8-44b7-b8ad-5b4a5494919b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:41.607839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb223-14c8-44b7-b8ad-5b4a5494919b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:41.622640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7eb223-14c8-44b7-b8ad-5b4a5494919b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:41.625038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7eb223-14c8-44b7-b8ad-5b4a5494919b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3f7eb223-14c8-44b7-b8ad-5b4a5494919b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:41.644850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:41.645894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:41.646787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:41.646787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:41.646787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:41.646965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 448/891] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:41.653565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb223-14c8-44b7-b8ad-5b4a5494919b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:41.686658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8207e-5ccc-4561-8605-ff24b464751f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:41.724238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dab4d-f014-4ca9-bbb1-a285605a94eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:41.724823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dab4d-f014-4ca9-bbb1-a285605a94eb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:41.725091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dab4d-f014-4ca9-bbb1-a285605a94eb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:41.725568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dab4d-f014-4ca9-bbb1-a285605a94eb None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:41.726473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dab4d-f014-4ca9-bbb1-a285605a94eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:41.726772 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dab4d-f014-4ca9-bbb1-a285605a94eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:41.728138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dab4d-f014-4ca9-bbb1-a285605a94eb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:41.733117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 444/892] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 17 16:06:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:41.738498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dab4d-f014-4ca9-bbb1-a285605a94eb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:41.770478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb223-14c8-44b7-b8ad-5b4a5494919b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:41.772602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:41.808795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea463a9-02a9-4b51-a940-ea94806e1520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:41.810015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea463a9-02a9-4b51-a940-ea94806e1520 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:41.810296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea463a9-02a9-4b51-a940-ea94806e1520 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:41.810817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea463a9-02a9-4b51-a940-ea94806e1520 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:41.811474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea463a9-02a9-4b51-a940-ea94806e1520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:41.811771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea463a9-02a9-4b51-a940-ea94806e1520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:41.814254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea463a9-02a9-4b51-a940-ea94806e1520 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:41.831536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 449/893] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:41.831536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea463a9-02a9-4b51-a940-ea94806e1520 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:41.853080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dab4d-f014-4ca9-bbb1-a285605a94eb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:41.856630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:41.892480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64132205-e957-438a-b0b7-12ea2d8341e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:41.893116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64132205-e957-438a-b0b7-12ea2d8341e9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:41.893412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64132205-e957-438a-b0b7-12ea2d8341e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:41.893693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64132205-e957-438a-b0b7-12ea2d8341e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:41.894427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64132205-e957-438a-b0b7-12ea2d8341e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:41.895783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64132205-e957-438a-b0b7-12ea2d8341e9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-64132205-e957-438a-b0b7-12ea2d8341e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:41.908927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:41.910093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:06:41.910946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:41.913554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 445/894] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:06:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:41.914715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64132205-e957-438a-b0b7-12ea2d8341e9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:41.936203 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea463a9-02a9-4b51-a940-ea94806e1520 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:41.975524 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d7c2a-fd7e-46ca-97fb-126c37e4ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:41.976445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d7c2a-fd7e-46ca-97fb-126c37e4ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:41.976889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d7c2a-fd7e-46ca-97fb-126c37e4ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:41.977198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d7c2a-fd7e-46ca-97fb-126c37e4ffd8 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:41.977862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d7c2a-fd7e-46ca-97fb-126c37e4ffd8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:41.978163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d7c2a-fd7e-46ca-97fb-126c37e4ffd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:41.979578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d7c2a-fd7e-46ca-97fb-126c37e4ffd8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:41.983907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 450/895] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 17 16:06:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:41.984683 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d7c2a-fd7e-46ca-97fb-126c37e4ffd8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:42.029231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:42.036781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64132205-e957-438a-b0b7-12ea2d8341e9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:42.079840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f61e1-3a6b-4d2d-aa97-eb07f713b8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:42.080910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f61e1-3a6b-4d2d-aa97-eb07f713b8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:42.081191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f61e1-3a6b-4d2d-aa97-eb07f713b8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:42.085625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f61e1-3a6b-4d2d-aa97-eb07f713b8a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:42.097232 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f61e1-3a6b-4d2d-aa97-eb07f713b8a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:42.099208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f61e1-3a6b-4d2d-aa97-eb07f713b8a4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:42.106815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-316f61e1-3a6b-4d2d-aa97-eb07f713b8a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:42.113483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:42.114453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:42.115454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:42.115454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:42.115454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:42.115454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:42.115454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:42.115454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:42.115454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:42.115454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:42.118842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 446/896] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:42.125553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d7c2a-fd7e-46ca-97fb-126c37e4ffd8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:42.125687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f61e1-3a6b-4d2d-aa97-eb07f713b8a4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:42.167823 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9feaa-241a-4575-9d44-ae50f007817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:42.168440 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9feaa-241a-4575-9d44-ae50f007817b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:42.168713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9feaa-241a-4575-9d44-ae50f007817b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:42.168982 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9feaa-241a-4575-9d44-ae50f007817b None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:42.169643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9feaa-241a-4575-9d44-ae50f007817b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:42.169940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9feaa-241a-4575-9d44-ae50f007817b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:42.171311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9feaa-241a-4575-9d44-ae50f007817b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:42.176070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 451/897] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:06:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:42.182459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9feaa-241a-4575-9d44-ae50f007817b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:42.245153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f61e1-3a6b-4d2d-aa97-eb07f713b8a4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:42.281690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d225b-d3b9-40b3-8b59-3b8bc2de396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:42.282740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d225b-d3b9-40b3-8b59-3b8bc2de396b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:42.283236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d225b-d3b9-40b3-8b59-3b8bc2de396b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:42.283739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d225b-d3b9-40b3-8b59-3b8bc2de396b None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:42.284623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d225b-d3b9-40b3-8b59-3b8bc2de396b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:42.285108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d225b-d3b9-40b3-8b59-3b8bc2de396b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:42.286722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d225b-d3b9-40b3-8b59-3b8bc2de396b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:42.304202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 447/898] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:42.306105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d225b-d3b9-40b3-8b59-3b8bc2de396b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:42.309750 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9feaa-241a-4575-9d44-ae50f007817b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:42.349811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:42.350166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78895279-384e-4ed8-8f28-f0ff70b54361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:42.351888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78895279-384e-4ed8-8f28-f0ff70b54361 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:42.352397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78895279-384e-4ed8-8f28-f0ff70b54361 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:42.352885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78895279-384e-4ed8-8f28-f0ff70b54361 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:42.353784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78895279-384e-4ed8-8f28-f0ff70b54361 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:42.354317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78895279-384e-4ed8-8f28-f0ff70b54361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:42.355847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78895279-384e-4ed8-8f28-f0ff70b54361 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:42.361650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 452/899] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:06:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:42.367748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78895279-384e-4ed8-8f28-f0ff70b54361 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:42.417730 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:42.426422 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d225b-d3b9-40b3-8b59-3b8bc2de396b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:42.462893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758de6a-184b-40b4-8f57-3a7371fd361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:42.463875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758de6a-184b-40b4-8f57-3a7371fd361e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:42.464345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758de6a-184b-40b4-8f57-3a7371fd361e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:42.464868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758de6a-184b-40b4-8f57-3a7371fd361e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:42.465825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758de6a-184b-40b4-8f57-3a7371fd361e None admin] RBAC: Adding query filter params (role.id=2ab4ea75bfa748869c320610d3ca5088, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=666d255c72394f4e9faaeb5b94253cf1) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:42.466327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758de6a-184b-40b4-8f57-3a7371fd361e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:42.468006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758de6a-184b-40b4-8f57-3a7371fd361e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:42.474629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 448/900] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:42 2022] GET /identity/v3/role_assignments?user.id=666d255c72394f4e9faaeb5b94253cf1&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2ab4ea75bfa748869c320610d3ca5088 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:42.493066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78895279-384e-4ed8-8f28-f0ff70b54361 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:42.529934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64269d05-ee45-44d5-9391-b2fffe7a4abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:42.530566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64269d05-ee45-44d5-9391-b2fffe7a4abc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:42.530842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64269d05-ee45-44d5-9391-b2fffe7a4abc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:42.531115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64269d05-ee45-44d5-9391-b2fffe7a4abc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:42.531916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64269d05-ee45-44d5-9391-b2fffe7a4abc None admin] RBAC: Adding query filter params (interface=public, service_id=54a4e15e3eeb4ac9836b9baa448f7038, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:42.532221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64269d05-ee45-44d5-9391-b2fffe7a4abc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:42.533742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64269d05-ee45-44d5-9391-b2fffe7a4abc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:42.543666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 453/901] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 17 16:06:42 2022] GET /identity/v3/endpoints?service_id=54a4e15e3eeb4ac9836b9baa448f7038&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:42.549215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758de6a-184b-40b4-8f57-3a7371fd361e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:42.647788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:42.667945 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758de6a-184b-40b4-8f57-3a7371fd361e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:42.703966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed630b49-2f57-40dc-a391-1a758c9106ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:42.704628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed630b49-2f57-40dc-a391-1a758c9106ff None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:42.704895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed630b49-2f57-40dc-a391-1a758c9106ff None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:42.705170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed630b49-2f57-40dc-a391-1a758c9106ff None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:42.705807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed630b49-2f57-40dc-a391-1a758c9106ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:42.707162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed630b49-2f57-40dc-a391-1a758c9106ff None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:42.713896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 449/902] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 17 16:06:42 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:06:43.339405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966152a-d7e8-4e0f-88cd-f65872abcdb6 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:43.339956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966152a-d7e8-4e0f-88cd-f65872abcdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:43.339956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966152a-d7e8-4e0f-88cd-f65872abcdb6 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:43.341476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 454/903] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:43.346818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330612f-49eb-4ca6-937c-838f2853cc5c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:43.347111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330612f-49eb-4ca6-937c-838f2853cc5c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:43.347383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330612f-49eb-4ca6-937c-838f2853cc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:43.366436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3330612f-49eb-4ca6-937c-838f2853cc5c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:43.367834 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3330612f-49eb-4ca6-937c-838f2853cc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:43.438828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 450/904] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:43.711759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966152a-d7e8-4e0f-88cd-f65872abcdb6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:43.796379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:43.816412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966152a-d7e8-4e0f-88cd-f65872abcdb6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:43.854619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c5e43-184b-4946-93d1-c93a15cac239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:43.855257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c5e43-184b-4946-93d1-c93a15cac239 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:43.855531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c5e43-184b-4946-93d1-c93a15cac239 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:43.855842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c5e43-184b-4946-93d1-c93a15cac239 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:43.856429 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c5e43-184b-4946-93d1-c93a15cac239 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:43.857845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c5e43-184b-4946-93d1-c93a15cac239 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-576c5e43-184b-4946-93d1-c93a15cac239 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:43.871499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:43.872486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:43.873978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 455/905] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 17 16:06:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:43.878586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330612f-49eb-4ca6-937c-838f2853cc5c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:43.975052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:43.992644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330612f-49eb-4ca6-937c-838f2853cc5c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:44.013615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebef2d-2029-470b-9959-fe94c0171670 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:44.013947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebef2d-2029-470b-9959-fe94c0171670 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:44.014165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebef2d-2029-470b-9959-fe94c0171670 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:44.016311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 456/906] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:44.021345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2796a-195c-4afa-ae72-ff65c7a2a57d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:44.021655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2796a-195c-4afa-ae72-ff65c7a2a57d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:44.021927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2796a-195c-4afa-ae72-ff65c7a2a57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:44.031703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cae4f-3321-49a8-973a-0f71211cdf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:44.032315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cae4f-3321-49a8-973a-0f71211cdf61 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:44.032592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cae4f-3321-49a8-973a-0f71211cdf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:44.032860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cae4f-3321-49a8-973a-0f71211cdf61 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:44.033542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cae4f-3321-49a8-973a-0f71211cdf61 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:44.033844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cae4f-3321-49a8-973a-0f71211cdf61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:44.035320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cae4f-3321-49a8-973a-0f71211cdf61 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:44.041037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 451/907] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 17 16:06:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:44.041256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-48c2796a-195c-4afa-ae72-ff65c7a2a57d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:44.042468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-48c2796a-195c-4afa-ae72-ff65c7a2a57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:44.050340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cae4f-3321-49a8-973a-0f71211cdf61 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:44.127280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 457/908] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:44.168981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cae4f-3321-49a8-973a-0f71211cdf61 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:44.205779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9a31d-444a-4869-89fc-a7d3fb4adc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:44.206680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9a31d-444a-4869-89fc-a7d3fb4adc2a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:44.207105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9a31d-444a-4869-89fc-a7d3fb4adc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:44.207574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9a31d-444a-4869-89fc-a7d3fb4adc2a None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:44.208345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9a31d-444a-4869-89fc-a7d3fb4adc2a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:44.208793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9a31d-444a-4869-89fc-a7d3fb4adc2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:44.210942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9a31d-444a-4869-89fc-a7d3fb4adc2a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:44.216681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 452/909] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 17 16:06:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:44.222223 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2796a-195c-4afa-ae72-ff65c7a2a57d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:44.299824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:44.327520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2796a-195c-4afa-ae72-ff65c7a2a57d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:44.362878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfdfbd-c623-44ba-99fe-8733ea4a51b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:44.363533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdfbd-c623-44ba-99fe-8733ea4a51b7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:44.363797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdfbd-c623-44ba-99fe-8733ea4a51b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:44.364013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdfbd-c623-44ba-99fe-8733ea4a51b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:44.364719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfdfbd-c623-44ba-99fe-8733ea4a51b7 None admin] RBAC: Adding query filter params (interface=public, service_id=d6d58c503b3f4eebbd8922d12223d932, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:44.365027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfdfbd-c623-44ba-99fe-8733ea4a51b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:44.367048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfdfbd-c623-44ba-99fe-8733ea4a51b7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:44.372779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 458/910] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 17 16:06:44 2022] GET /identity/v3/endpoints?service_id=d6d58c503b3f4eebbd8922d12223d932&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:44.378233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9a31d-444a-4869-89fc-a7d3fb4adc2a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:44.381387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:44.408419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfdfbd-c623-44ba-99fe-8733ea4a51b7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:44.500538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9a31d-444a-4869-89fc-a7d3fb4adc2a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:44.516307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfdfbd-c623-44ba-99fe-8733ea4a51b7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:44.537718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed1fc4-8072-4549-a7e5-a82d80b9b3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:44.538558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed1fc4-8072-4549-a7e5-a82d80b9b3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:44.538971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed1fc4-8072-4549-a7e5-a82d80b9b3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:44.539245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed1fc4-8072-4549-a7e5-a82d80b9b3f1 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:44.539950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed1fc4-8072-4549-a7e5-a82d80b9b3f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:44.541318 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed1fc4-8072-4549-a7e5-a82d80b9b3f1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:44.547239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 453/911] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 17 16:06:44 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:06:44.547239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0b7a0-1da2-4cc7-a613-ea0418daf74f None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:44.547239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0b7a0-1da2-4cc7-a613-ea0418daf74f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:44.547239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0b7a0-1da2-4cc7-a613-ea0418daf74f None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:44.550640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 454/912] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:44.554973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914659d-4506-4d9e-913b-bab2b99ac775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:44.555841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914659d-4506-4d9e-913b-bab2b99ac775 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:44.556344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914659d-4506-4d9e-913b-bab2b99ac775 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:44.556759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914659d-4506-4d9e-913b-bab2b99ac775 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:44.557694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914659d-4506-4d9e-913b-bab2b99ac775 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:44.559262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914659d-4506-4d9e-913b-bab2b99ac775 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:44.567964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e172cb-43ff-4ec5-bbb3-ebd316df8841 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:44.568536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e172cb-43ff-4ec5-bbb3-ebd316df8841 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:44.568990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e172cb-43ff-4ec5-bbb3-ebd316df8841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:44.590141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-84e172cb-43ff-4ec5-bbb3-ebd316df8841 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:44.591606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-84e172cb-43ff-4ec5-bbb3-ebd316df8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:44.609877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:44.622298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 459/913] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:06:44 2022] POST /identity/v3/services => generated 241 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:06:44.674735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:44.694951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 455/914] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:44.699775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7887b5-028b-42f2-b0e9-f3945473a883 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:44.700056 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7887b5-028b-42f2-b0e9-f3945473a883 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:44.700382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7887b5-028b-42f2-b0e9-f3945473a883 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:44.701792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 460/915] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:44.707492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56490308-4a95-4e7c-a4f8-cda0b6fc524e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:44.707781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56490308-4a95-4e7c-a4f8-cda0b6fc524e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:44.708057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56490308-4a95-4e7c-a4f8-cda0b6fc524e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:44.727752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-56490308-4a95-4e7c-a4f8-cda0b6fc524e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:44.728980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-56490308-4a95-4e7c-a4f8-cda0b6fc524e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:44.802209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 456/916] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:44.964817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7887b5-028b-42f2-b0e9-f3945473a883 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:45.072687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7887b5-028b-42f2-b0e9-f3945473a883 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:45.107701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56490308-4a95-4e7c-a4f8-cda0b6fc524e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:45.110911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe411-097d-4bde-af99-5b139146291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:45.111165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe411-097d-4bde-af99-5b139146291a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:45.111434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe411-097d-4bde-af99-5b139146291a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:45.111701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe411-097d-4bde-af99-5b139146291a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:45.126286 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afe411-097d-4bde-af99-5b139146291a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a6afe411-097d-4bde-af99-5b139146291a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:45.131280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:45.132297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:45.133432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 461/917] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 17 16:06:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:45.142605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe411-097d-4bde-af99-5b139146291a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:45.218303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:45.227473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56490308-4a95-4e7c-a4f8-cda0b6fc524e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:45.253449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:45.265857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a336d6-f63e-4e53-8284-974ef061ac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:45.267209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a336d6-f63e-4e53-8284-974ef061ac3d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:45.267209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a336d6-f63e-4e53-8284-974ef061ac3d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:45.267370 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a336d6-f63e-4e53-8284-974ef061ac3d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:45.267921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a336d6-f63e-4e53-8284-974ef061ac3d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:45.269649 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a336d6-f63e-4e53-8284-974ef061ac3d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:45.279195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe411-097d-4bde-af99-5b139146291a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-68a336d6-f63e-4e53-8284-974ef061ac3d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:45.279560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:45.280714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:06:45.281696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:45.284301 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 457/918] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:06:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:45.290352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a336d6-f63e-4e53-8284-974ef061ac3d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:45.325641 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258da683-46e6-4211-8607-178d485d7be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:45.326879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da683-46e6-4211-8607-178d485d7be9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:45.327458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da683-46e6-4211-8607-178d485d7be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:45.327972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da683-46e6-4211-8607-178d485d7be9 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:45.329018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258da683-46e6-4211-8607-178d485d7be9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:45.329488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258da683-46e6-4211-8607-178d485d7be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:45.331669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258da683-46e6-4211-8607-178d485d7be9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:45.347139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 462/919] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 17 16:06:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:45.347890 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258da683-46e6-4211-8607-178d485d7be9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:45.416259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a336d6-f63e-4e53-8284-974ef061ac3d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:45.455571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500c249-016c-4e10-a4a4-323b0e7948ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:45.456183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500c249-016c-4e10-a4a4-323b0e7948ba None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:45.456461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500c249-016c-4e10-a4a4-323b0e7948ba None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:45.456729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500c249-016c-4e10-a4a4-323b0e7948ba None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:45.457374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500c249-016c-4e10-a4a4-323b0e7948ba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:45.457685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500c249-016c-4e10-a4a4-323b0e7948ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:45.459278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500c249-016c-4e10-a4a4-323b0e7948ba None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:45.465951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 458/920] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:06:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:45.471140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500c249-016c-4e10-a4a4-323b0e7948ba None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:45.480709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258da683-46e6-4211-8607-178d485d7be9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:45.502405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:45.517320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c4da-5347-4451-b8a7-cb9272b3f5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:45.518273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c4da-5347-4451-b8a7-cb9272b3f5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:45.518835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c4da-5347-4451-b8a7-cb9272b3f5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:45.519341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c4da-5347-4451-b8a7-cb9272b3f5a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:45.531617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06c4da-5347-4451-b8a7-cb9272b3f5a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:45.533156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06c4da-5347-4451-b8a7-cb9272b3f5a9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5c06c4da-5347-4451-b8a7-cb9272b3f5a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:45.547670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:45.548636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:45.549853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:45.549853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:45.549853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:45.553571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 463/921] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:45.554622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:45.555281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c4da-5347-4451-b8a7-cb9272b3f5a9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:45.608049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500c249-016c-4e10-a4a4-323b0e7948ba None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:45.650940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12443-c526-4efb-9718-a2bd3d2c150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:45.651560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12443-c526-4efb-9718-a2bd3d2c150e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:45.651910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12443-c526-4efb-9718-a2bd3d2c150e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:45.652194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12443-c526-4efb-9718-a2bd3d2c150e None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:45.653295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12443-c526-4efb-9718-a2bd3d2c150e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:45.653649 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12443-c526-4efb-9718-a2bd3d2c150e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:45.655499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12443-c526-4efb-9718-a2bd3d2c150e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:45.663045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 459/922] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 17 16:06:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:45.674316 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12443-c526-4efb-9718-a2bd3d2c150e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:45.686787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c4da-5347-4451-b8a7-cb9272b3f5a9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:45.727283 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c164f-9524-4ad2-bd33-5b6a6f22e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:45.728079 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c164f-9524-4ad2-bd33-5b6a6f22e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:45.728457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c164f-9524-4ad2-bd33-5b6a6f22e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:45.728830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c164f-9524-4ad2-bd33-5b6a6f22e3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:45.729700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c164f-9524-4ad2-bd33-5b6a6f22e3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:45.730232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c164f-9524-4ad2-bd33-5b6a6f22e3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:45.731820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c164f-9524-4ad2-bd33-5b6a6f22e3a4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:45.750434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 464/923] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:45.751755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c164f-9524-4ad2-bd33-5b6a6f22e3a4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:45.786048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:45.804056 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12443-c526-4efb-9718-a2bd3d2c150e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:45.827629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:45.860299 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c956eab-e9c4-4d93-9a83-4e5a70182a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:45.860845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c956eab-e9c4-4d93-9a83-4e5a70182a8a None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:45.861122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c956eab-e9c4-4d93-9a83-4e5a70182a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:45.861412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c956eab-e9c4-4d93-9a83-4e5a70182a8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:45.862505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c956eab-e9c4-4d93-9a83-4e5a70182a8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:45.864173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c956eab-e9c4-4d93-9a83-4e5a70182a8a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:45.874780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c164f-9524-4ad2-bd33-5b6a6f22e3a4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:45.914977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51dd1-d7cd-441c-9e7c-9972497d569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:45.915675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51dd1-d7cd-441c-9e7c-9972497d569e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:45.916003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51dd1-d7cd-441c-9e7c-9972497d569e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:45.916256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51dd1-d7cd-441c-9e7c-9972497d569e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:45.923426 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b51dd1-d7cd-441c-9e7c-9972497d569e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:45.924932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b51dd1-d7cd-441c-9e7c-9972497d569e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:45.945397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 460/924] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:06:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c7b51dd1-d7cd-441c-9e7c-9972497d569e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:45.945581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:45.946488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:45.947446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:45.947446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:45.947446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:45.947446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:45.947446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:45.947446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:45.947446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:45.947446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:45.947446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:45.947446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:45.950479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 465/925] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 17 16:06:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:45.951912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c956eab-e9c4-4d93-9a83-4e5a70182a8a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:46.076543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c956eab-e9c4-4d93-9a83-4e5a70182a8a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:46.115021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98091a84-2764-434b-a169-7012980e34ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:46.115647 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98091a84-2764-434b-a169-7012980e34ea None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:46.115879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98091a84-2764-434b-a169-7012980e34ea None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:46.116829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98091a84-2764-434b-a169-7012980e34ea None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:46.117744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98091a84-2764-434b-a169-7012980e34ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:46.118066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98091a84-2764-434b-a169-7012980e34ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:46.119580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98091a84-2764-434b-a169-7012980e34ea None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:46.140469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 461/926] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 17 16:06:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:46.145684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51dd1-d7cd-441c-9e7c-9972497d569e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:46.244671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:46.254355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51dd1-d7cd-441c-9e7c-9972497d569e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:46.290993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad467-a836-4d64-8dba-be2588b79b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:46.291938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad467-a836-4d64-8dba-be2588b79b90 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:46.292397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad467-a836-4d64-8dba-be2588b79b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:46.292870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad467-a836-4d64-8dba-be2588b79b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:46.304349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccad467-a836-4d64-8dba-be2588b79b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:46.306060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccad467-a836-4d64-8dba-be2588b79b90 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0ccad467-a836-4d64-8dba-be2588b79b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:46.321751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:46.322733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:46.323648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:46.323648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:46.323648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:46.325466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 466/927] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:46.334525 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98091a84-2764-434b-a169-7012980e34ea None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:46.362758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:46.441795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98091a84-2764-434b-a169-7012980e34ea None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:46.478029 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e18b00-450f-4082-9515-1b71bf788050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:46.478649 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e18b00-450f-4082-9515-1b71bf788050 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:46.478927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e18b00-450f-4082-9515-1b71bf788050 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:46.479199 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e18b00-450f-4082-9515-1b71bf788050 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:46.479848 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e18b00-450f-4082-9515-1b71bf788050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:46.480154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e18b00-450f-4082-9515-1b71bf788050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:46.481594 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e18b00-450f-4082-9515-1b71bf788050 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:46.497499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 462/928] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:46.499856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad467-a836-4d64-8dba-be2588b79b90 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:46.614229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4e6a4-86c2-481d-a4b5-dd4d6d5d750a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:46.614636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4e6a4-86c2-481d-a4b5-dd4d6d5d750a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:46.615335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4e6a4-86c2-481d-a4b5-dd4d6d5d750a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:46.617377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 463/929] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:06:46.618202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad467-a836-4d64-8dba-be2588b79b90 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:46.623768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166ccbf-ae05-4dff-a118-5e71f479a26b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:46.624052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166ccbf-ae05-4dff-a118-5e71f479a26b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:46.624328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166ccbf-ae05-4dff-a118-5e71f479a26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:46.648344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6166ccbf-ae05-4dff-a118-5e71f479a26b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:46.650087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6166ccbf-ae05-4dff-a118-5e71f479a26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:46.656441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667d1ee-10d7-4c09-ac35-9740f3f868a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:46.657084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667d1ee-10d7-4c09-ac35-9740f3f868a0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:46.657386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667d1ee-10d7-4c09-ac35-9740f3f868a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:46.657656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667d1ee-10d7-4c09-ac35-9740f3f868a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:46.665631 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667d1ee-10d7-4c09-ac35-9740f3f868a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:46.667086 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667d1ee-10d7-4c09-ac35-9740f3f868a0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9667d1ee-10d7-4c09-ac35-9740f3f868a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:46.679623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:46.680533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:46.681470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:46.681470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:46.681470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:46.681470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:46.681470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:46.681470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:46.681470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:46.681470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:46.681924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 467/930] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:46.682795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c9a4-ec2d-4451-978b-e65547c4afe6 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:46.683070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c9a4-ec2d-4451-978b-e65547c4afe6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:46.683336 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c9a4-ec2d-4451-978b-e65547c4afe6 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:46.689218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 468/931] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:46.690006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8c9a4-ec2d-4451-978b-e65547c4afe6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:46.694623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:46.736317 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 464/932] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:46.738090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201cd0-ed66-4216-8ed1-a8de3bee52f7 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:46.738519 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201cd0-ed66-4216-8ed1-a8de3bee52f7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:46.738926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201cd0-ed66-4216-8ed1-a8de3bee52f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:46.764406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-da201cd0-ed66-4216-8ed1-a8de3bee52f7 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:46.765874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-da201cd0-ed66-4216-8ed1-a8de3bee52f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:46.777327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:46.816797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8c9a4-ec2d-4451-978b-e65547c4afe6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:46.838846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 465/933] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:46.863679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735f477-170e-4f33-b991-905c12bfcd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:46.864619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735f477-170e-4f33-b991-905c12bfcd26 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:46.865046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735f477-170e-4f33-b991-905c12bfcd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:46.865494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735f477-170e-4f33-b991-905c12bfcd26 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:46.866403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735f477-170e-4f33-b991-905c12bfcd26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:46.866930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735f477-170e-4f33-b991-905c12bfcd26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:46.868637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735f477-170e-4f33-b991-905c12bfcd26 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:46.885504 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 469/934] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:46.888389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da201cd0-ed66-4216-8ed1-a8de3bee52f7 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:47.002300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da201cd0-ed66-4216-8ed1-a8de3bee52f7 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:47.013905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735f477-170e-4f33-b991-905c12bfcd26 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:47.046629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3792f2c-0434-452a-b0c1-b49a5b3f305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:47.047296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3792f2c-0434-452a-b0c1-b49a5b3f305e None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:47.047573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3792f2c-0434-452a-b0c1-b49a5b3f305e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:47.047842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3792f2c-0434-452a-b0c1-b49a5b3f305e None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/666d255c72394f4e9faaeb5b94253cf1/roles/2ab4ea75bfa748869c320610d3ca5088` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:47.051163 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3792f2c-0434-452a-b0c1-b49a5b3f305e None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=666d255c72394f4e9faaeb5b94253cf1, role_id=2ab4ea75bfa748869c320610d3ca5088)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:47.053398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3792f2c-0434-452a-b0c1-b49a5b3f305e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:47.089657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:47.128127 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735f477-170e-4f33-b991-905c12bfcd26 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:47.152876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 466/935] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:06:46 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/666d255c72394f4e9faaeb5b94253cf1/roles/2ab4ea75bfa748869c320610d3ca5088 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:06:47.153905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3792f2c-0434-452a-b0c1-b49a5b3f305e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:47.157897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:47.173325 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17ff4-e770-43b3-8216-4569938059d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:47.174026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17ff4-e770-43b3-8216-4569938059d9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:47.174305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17ff4-e770-43b3-8216-4569938059d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:47.174577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17ff4-e770-43b3-8216-4569938059d9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:47.175172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a17ff4-e770-43b3-8216-4569938059d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:47.176600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a17ff4-e770-43b3-8216-4569938059d9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c7a17ff4-e770-43b3-8216-4569938059d9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:47.188947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:47.190141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:47.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 470/936] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 17 16:06:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:47.198170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17ff4-e770-43b3-8216-4569938059d9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:47.298510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3792f2c-0434-452a-b0c1-b49a5b3f305e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:47.316103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17ff4-e770-43b3-8216-4569938059d9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:47.335751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3933c47-3298-4ef7-9d6a-86599e82b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:47.336382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3933c47-3298-4ef7-9d6a-86599e82b930 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:47.336678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3933c47-3298-4ef7-9d6a-86599e82b930 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:47.336921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3933c47-3298-4ef7-9d6a-86599e82b930 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:47.337529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3933c47-3298-4ef7-9d6a-86599e82b930 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:47.338887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3933c47-3298-4ef7-9d6a-86599e82b930 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b3933c47-3298-4ef7-9d6a-86599e82b930 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:47.348140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:47.349166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:47.350095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 467/937] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 17 16:06:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:47.355195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3933c47-3298-4ef7-9d6a-86599e82b930 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:47.362538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:47.367808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e128f2e-e116-4049-81c0-402fadeabcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:47.369129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e128f2e-e116-4049-81c0-402fadeabcbd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:47.369775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e128f2e-e116-4049-81c0-402fadeabcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:47.370337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e128f2e-e116-4049-81c0-402fadeabcbd None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:47.371170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e128f2e-e116-4049-81c0-402fadeabcbd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:47.371902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e128f2e-e116-4049-81c0-402fadeabcbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:47.374306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e128f2e-e116-4049-81c0-402fadeabcbd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:47.381101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 471/938] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 17 16:06:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:47.393393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e128f2e-e116-4049-81c0-402fadeabcbd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:47.446596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:47.494905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3933c47-3298-4ef7-9d6a-86599e82b930 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:47.496410 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e128f2e-e116-4049-81c0-402fadeabcbd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:47.535835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f83a-80f7-4228-bf80-be019c35ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:47.536596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f83a-80f7-4228-bf80-be019c35ce49 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:47.536966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f83a-80f7-4228-bf80-be019c35ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:47.537329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f83a-80f7-4228-bf80-be019c35ce49 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:47.538129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1f83a-80f7-4228-bf80-be019c35ce49 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:47.538709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1f83a-80f7-4228-bf80-be019c35ce49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:47.538914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc4cf-4776-478c-864e-3097153a833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:47.539527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc4cf-4776-478c-864e-3097153a833d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:47.539801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc4cf-4776-478c-864e-3097153a833d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:47.540063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc4cf-4776-478c-864e-3097153a833d None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:47.540540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1f83a-80f7-4228-bf80-be019c35ce49 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:47.540683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cc4cf-4776-478c-864e-3097153a833d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:47.540981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cc4cf-4776-478c-864e-3097153a833d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:47.542669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cc4cf-4776-478c-864e-3097153a833d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:47.547436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 472/939] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 17 16:06:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:47.548320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 468/940] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 17 16:06:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:47.554782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f83a-80f7-4228-bf80-be019c35ce49 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:47.555175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc4cf-4776-478c-864e-3097153a833d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:47.630524 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:47.681989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc4cf-4776-478c-864e-3097153a833d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:47.694188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f83a-80f7-4228-bf80-be019c35ce49 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:47.713841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:47.719554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca6bd-4f18-4104-8497-902ecb49b326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:47.720346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca6bd-4f18-4104-8497-902ecb49b326 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:47.720632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca6bd-4f18-4104-8497-902ecb49b326 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:47.721346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca6bd-4f18-4104-8497-902ecb49b326 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:47.722109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ca6bd-4f18-4104-8497-902ecb49b326 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:47.723998 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ca6bd-4f18-4104-8497-902ecb49b326 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:47.737004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c45b07-e8bd-4721-b786-ef4bba99a167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:47.737845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c45b07-e8bd-4721-b786-ef4bba99a167 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:47.738226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c45b07-e8bd-4721-b786-ef4bba99a167 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:47.738565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c45b07-e8bd-4721-b786-ef4bba99a167 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:47.739262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c45b07-e8bd-4721-b786-ef4bba99a167 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:47.739639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c45b07-e8bd-4721-b786-ef4bba99a167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:47.741714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c45b07-e8bd-4721-b786-ef4bba99a167 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:47.747264 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 473/941] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 17 16:06:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:47.752990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c45b07-e8bd-4721-b786-ef4bba99a167 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:47.845973 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 469/942] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:06:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:47.867278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c45b07-e8bd-4721-b786-ef4bba99a167 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:47.892660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:47.915219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890efb3-534e-4d4d-8bb0-dc4d1a8c7122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:47.915877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890efb3-534e-4d4d-8bb0-dc4d1a8c7122 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:47.916157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890efb3-534e-4d4d-8bb0-dc4d1a8c7122 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:47.916425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890efb3-534e-4d4d-8bb0-dc4d1a8c7122 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:47.917136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890efb3-534e-4d4d-8bb0-dc4d1a8c7122 None admin] RBAC: Adding query filter params (interface=public, service_id=e75ca65f831848ad8932da4a241c3a2f, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:47.917472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890efb3-534e-4d4d-8bb0-dc4d1a8c7122 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:47.919054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890efb3-534e-4d4d-8bb0-dc4d1a8c7122 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:47.925561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 474/943] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 17 16:06:47 2022] GET /identity/v3/endpoints?service_id=e75ca65f831848ad8932da4a241c3a2f&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:47.931760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca6bd-4f18-4104-8497-902ecb49b326 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:48.049175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca6bd-4f18-4104-8497-902ecb49b326 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:48.081145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a2f56-9bfe-4132-8f79-28fc1e21931d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:48.081506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a2f56-9bfe-4132-8f79-28fc1e21931d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:48.081749 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a2f56-9bfe-4132-8f79-28fc1e21931d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:48.083100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 475/944] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:06:48.088707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1c10-7d8b-4383-b760-a223b95fc715 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:48.088993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1c10-7d8b-4383-b760-a223b95fc715 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:48.089268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1c10-7d8b-4383-b760-a223b95fc715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:48.089746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7c60c-3f47-412f-a056-3ac125fe1f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:48.090600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7c60c-3f47-412f-a056-3ac125fe1f84 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:48.090879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7c60c-3f47-412f-a056-3ac125fe1f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:48.091150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7c60c-3f47-412f-a056-3ac125fe1f84 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:48.091759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7c60c-3f47-412f-a056-3ac125fe1f84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:48.093155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7c60c-3f47-412f-a056-3ac125fe1f84 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:48.101577 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 470/945] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 17 16:06:47 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:06:48.116148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6d9b1c10-7d8b-4383-b760-a223b95fc715 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:48.117310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6d9b1c10-7d8b-4383-b760-a223b95fc715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:48.194822 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 476/946] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:48.466122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7c60c-3f47-412f-a056-3ac125fe1f84 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:48.521893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:48.570672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7c60c-3f47-412f-a056-3ac125fe1f84 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:48.608284 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f8bee-76d3-4994-8441-ae5384e7b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:48.609137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f8bee-76d3-4994-8441-ae5384e7b8f4 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:48.609578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f8bee-76d3-4994-8441-ae5384e7b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:48.609985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f8bee-76d3-4994-8441-ae5384e7b8f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:48.610789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f8bee-76d3-4994-8441-ae5384e7b8f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:48.612337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f8bee-76d3-4994-8441-ae5384e7b8f4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:48.615103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: WARNING keystone.server.flask.common [None req-d94f8bee-76d3-4994-8441-ae5384e7b8f4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 16:06:48.659861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.sql.core [None req-d94f8bee-76d3-4994-8441-ae5384e7b8f4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 16:06:48.659861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 16:06:48.659861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [parameters: {'id': 'fae3970756b64123928301a5ac2bf6c1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 16:06:48.659861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81777) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-d94f8bee-76d3-4994-8441-ae5384e7b8f4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fae3970756b64123928301a5ac2bf6c1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fae3970756b64123928301a5ac2bf6c1. Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:06:48.667840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result.read() Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 16:06:48.668799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application yield resource Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise self.value Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application session.commit() Aug 17 16:06:48.670057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.session.flush() Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application compat.raise_( Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 16:06:48.671191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 16:06:48.672305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result.read() Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:06:48.673187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [parameters: {'id': 'fae3970756b64123928301a5ac2bf6c1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:48.681705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:48.682710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:48.684003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:48.684003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 16:06:48.684003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 16:06:48.684003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:48.684003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:48.684003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 16:06:48.684003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 16:06:48.684003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fae3970756b64123928301a5ac2bf6c1. Aug 17 16:06:48.684003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:48.684003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 471/947] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Aug 17 16:06:48 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:48.685004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b1c10-7d8b-4383-b760-a223b95fc715 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:48.790565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b1c10-7d8b-4383-b760-a223b95fc715 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:48.801560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:48.827234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86578fac-a65e-4f0f-8d53-f57613738dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:48.827881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86578fac-a65e-4f0f-8d53-f57613738dfc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:48.828159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86578fac-a65e-4f0f-8d53-f57613738dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:48.828430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86578fac-a65e-4f0f-8d53-f57613738dfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:48.835956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86578fac-a65e-4f0f-8d53-f57613738dfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:48.837440 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86578fac-a65e-4f0f-8d53-f57613738dfc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-86578fac-a65e-4f0f-8d53-f57613738dfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:48.848640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:48.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:48.850637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:48.850637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:48.850637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:48.850637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:48.850637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:48.850637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:48.850637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:48.850637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:48.850637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 477/948] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:48.857043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f8bee-76d3-4994-8441-ae5384e7b8f4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:48.969314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f8bee-76d3-4994-8441-ae5384e7b8f4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:48.981876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:49.007096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eaae0-0878-4757-8bbc-17f8f10eae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:49.007880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eaae0-0878-4757-8bbc-17f8f10eae9e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:49.008159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eaae0-0878-4757-8bbc-17f8f10eae9e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:49.008432 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eaae0-0878-4757-8bbc-17f8f10eae9e None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:49.009108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47eaae0-0878-4757-8bbc-17f8f10eae9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:49.009436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47eaae0-0878-4757-8bbc-17f8f10eae9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:49.011074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47eaae0-0878-4757-8bbc-17f8f10eae9e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:49.034202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 472/949] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:49.152341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b1a4-00e3-484c-832a-cbbdc8b1c76e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:49.152664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b1a4-00e3-484c-832a-cbbdc8b1c76e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:49.152889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b1a4-00e3-484c-832a-cbbdc8b1c76e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:49.154712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 478/950] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:49.160405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841aef8-7f8c-4a22-b856-a144f59c8ff8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:49.160698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841aef8-7f8c-4a22-b856-a144f59c8ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:49.160966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841aef8-7f8c-4a22-b856-a144f59c8ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:49.179907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-0841aef8-7f8c-4a22-b856-a144f59c8ff8 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:49.181443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0841aef8-7f8c-4a22-b856-a144f59c8ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:49.257740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 473/951] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:49.617337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5b1a4-00e3-484c-832a-cbbdc8b1c76e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:49.795783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5b1a4-00e3-484c-832a-cbbdc8b1c76e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:49.849911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d75f2-9baf-478b-9495-e2a2598e88c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:49.853387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d75f2-9baf-478b-9495-e2a2598e88c0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:49.853387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d75f2-9baf-478b-9495-e2a2598e88c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:49.854626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d75f2-9baf-478b-9495-e2a2598e88c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:49.873471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d75f2-9baf-478b-9495-e2a2598e88c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d68d75f2-9baf-478b-9495-e2a2598e88c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:49.875197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:49.876108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:49.877147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 479/952] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 17 16:06:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:49.885435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841aef8-7f8c-4a22-b856-a144f59c8ff8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:49.989322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:49.993797 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841aef8-7f8c-4a22-b856-a144f59c8ff8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:50.030020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c0f56-887d-44f6-8f8b-312fee1c93e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:50.031070 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c0f56-887d-44f6-8f8b-312fee1c93e9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.031577 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c0f56-887d-44f6-8f8b-312fee1c93e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.032059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c0f56-887d-44f6-8f8b-312fee1c93e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.032925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c0f56-887d-44f6-8f8b-312fee1c93e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:50.033486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c0f56-887d-44f6-8f8b-312fee1c93e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:50.035104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c0f56-887d-44f6-8f8b-312fee1c93e9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:50.044586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 474/953] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 17 16:06:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:50.048768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529cf6a-b5db-4842-a46d-fd4cb3e8fde9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.048768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529cf6a-b5db-4842-a46d-fd4cb3e8fde9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.048768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529cf6a-b5db-4842-a46d-fd4cb3e8fde9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.048768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 480/954] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:50.050317 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c0f56-887d-44f6-8f8b-312fee1c93e9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:50.053663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98ba83-22a4-4c5c-af15-212b2adda490 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.053663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98ba83-22a4-4c5c-af15-212b2adda490 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.053862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98ba83-22a4-4c5c-af15-212b2adda490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.078085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6c98ba83-22a4-4c5c-af15-212b2adda490 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:50.080309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6c98ba83-22a4-4c5c-af15-212b2adda490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:50.114510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:50.169475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 481/955] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:50.183895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c0f56-887d-44f6-8f8b-312fee1c93e9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:50.206035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ca843-5eb7-47c6-bf5f-b73b58b38e8d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.206316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ca843-5eb7-47c6-bf5f-b73b58b38e8d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.206593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ca843-5eb7-47c6-bf5f-b73b58b38e8d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.208177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 482/956] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:06:50.213892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c978d-53b5-457d-8b88-5655ac8a8a16 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.214171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c978d-53b5-457d-8b88-5655ac8a8a16 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.214443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c978d-53b5-457d-8b88-5655ac8a8a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.222002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161520aa-5841-4959-a8fc-a4b33f54582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:50.222701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161520aa-5841-4959-a8fc-a4b33f54582d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.222986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161520aa-5841-4959-a8fc-a4b33f54582d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.223259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161520aa-5841-4959-a8fc-a4b33f54582d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.234006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f39c978d-53b5-457d-8b88-5655ac8a8a16 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:50.234926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161520aa-5841-4959-a8fc-a4b33f54582d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:50.235691 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f39c978d-53b5-457d-8b88-5655ac8a8a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:50.236378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161520aa-5841-4959-a8fc-a4b33f54582d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-161520aa-5841-4959-a8fc-a4b33f54582d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:50.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:50.261447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:50.267264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:50.267264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:50.267264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:50.267264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 475/957] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:50.267264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161520aa-5841-4959-a8fc-a4b33f54582d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:50.286112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:50.323942 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 483/958] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:50.386633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161520aa-5841-4959-a8fc-a4b33f54582d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:50.425119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70f9bd-f4ee-4794-9533-0f3def8a345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:50.425687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70f9bd-f4ee-4794-9533-0f3def8a345b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.425964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70f9bd-f4ee-4794-9533-0f3def8a345b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.426235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70f9bd-f4ee-4794-9533-0f3def8a345b None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.426876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70f9bd-f4ee-4794-9533-0f3def8a345b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:50.427173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70f9bd-f4ee-4794-9533-0f3def8a345b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:50.429069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70f9bd-f4ee-4794-9533-0f3def8a345b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:50.438477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c978d-53b5-457d-8b88-5655ac8a8a16 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:50.441634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 476/959] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:50.448928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70f9bd-f4ee-4794-9533-0f3def8a345b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:50.536451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:50.544583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:50.549404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c978d-53b5-457d-8b88-5655ac8a8a16 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:50.576874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70f9bd-f4ee-4794-9533-0f3def8a345b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:50.584683 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9910357-20bb-4bbc-bc54-fd5ce58ba77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:50.585952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9910357-20bb-4bbc-bc54-fd5ce58ba77a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.586465 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9910357-20bb-4bbc-bc54-fd5ce58ba77a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.586914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9910357-20bb-4bbc-bc54-fd5ce58ba77a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.587688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9910357-20bb-4bbc-bc54-fd5ce58ba77a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:50.589233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9910357-20bb-4bbc-bc54-fd5ce58ba77a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d9910357-20bb-4bbc-bc54-fd5ce58ba77a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:50.598457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:50.599652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:06:50.601219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:50.608330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 484/960] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:50.609961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9910357-20bb-4bbc-bc54-fd5ce58ba77a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:50.614668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699002c-2c5d-4d07-a3da-16d50f1a09f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:50.614668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699002c-2c5d-4d07-a3da-16d50f1a09f3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.615066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699002c-2c5d-4d07-a3da-16d50f1a09f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.615435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699002c-2c5d-4d07-a3da-16d50f1a09f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.623933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699002c-2c5d-4d07-a3da-16d50f1a09f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:50.625402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699002c-2c5d-4d07-a3da-16d50f1a09f3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-9699002c-2c5d-4d07-a3da-16d50f1a09f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:50.639220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:50.640223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:50.641177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:50.641177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:50.641177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:50.641177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:50.641177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:50.641177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:50.641177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:50.641177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:50.641177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:06:50.641177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:50.641177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 477/961] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 17 16:06:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:50.645701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699002c-2c5d-4d07-a3da-16d50f1a09f3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:50.720342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9910357-20bb-4bbc-bc54-fd5ce58ba77a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:50.756097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf0618-c89a-4af3-bf11-a532482ac41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:50.756976 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0618-c89a-4af3-bf11-a532482ac41a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.757421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0618-c89a-4af3-bf11-a532482ac41a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.757835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0618-c89a-4af3-bf11-a532482ac41a None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.758622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf0618-c89a-4af3-bf11-a532482ac41a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:50.759062 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf0618-c89a-4af3-bf11-a532482ac41a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:50.760275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699002c-2c5d-4d07-a3da-16d50f1a09f3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:50.760746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf0618-c89a-4af3-bf11-a532482ac41a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:50.770971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 485/962] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:50.771555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf0618-c89a-4af3-bf11-a532482ac41a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:50.791090 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:50.792681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:50.798587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5b4f9-51c0-4ee9-a43f-58d13d134fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:50.799228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5b4f9-51c0-4ee9-a43f-58d13d134fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.799506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5b4f9-51c0-4ee9-a43f-58d13d134fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.799958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5b4f9-51c0-4ee9-a43f-58d13d134fb5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.800348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5b4f9-51c0-4ee9-a43f-58d13d134fb5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:50.801739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5b4f9-51c0-4ee9-a43f-58d13d134fb5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f3d5b4f9-51c0-4ee9-a43f-58d13d134fb5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:50.811165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:50.812216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:50.813174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 478/963] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 17 16:06:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:50.814045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5b4f9-51c0-4ee9-a43f-58d13d134fb5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:50.879611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf0618-c89a-4af3-bf11-a532482ac41a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:50.916741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732099e-9dd5-4f45-b587-2b5993c6134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:50.917351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732099e-9dd5-4f45-b587-2b5993c6134d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.917657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732099e-9dd5-4f45-b587-2b5993c6134d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.917936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732099e-9dd5-4f45-b587-2b5993c6134d None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.918663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732099e-9dd5-4f45-b587-2b5993c6134d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:50.918964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732099e-9dd5-4f45-b587-2b5993c6134d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:50.920392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732099e-9dd5-4f45-b587-2b5993c6134d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:50.936724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5b4f9-51c0-4ee9-a43f-58d13d134fb5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:50.939774 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 486/964] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 17 16:06:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:50.940619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732099e-9dd5-4f45-b587-2b5993c6134d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:50.980573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083fcf2-1b22-4309-a298-4d1e163626d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:50.981099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083fcf2-1b22-4309-a298-4d1e163626d2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:50.981395 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083fcf2-1b22-4309-a298-4d1e163626d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:50.981666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083fcf2-1b22-4309-a298-4d1e163626d2 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:50.982287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083fcf2-1b22-4309-a298-4d1e163626d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:50.982583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083fcf2-1b22-4309-a298-4d1e163626d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:50.983979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083fcf2-1b22-4309-a298-4d1e163626d2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:50.997404 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 479/965] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:50.997404 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083fcf2-1b22-4309-a298-4d1e163626d2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:51.039540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:51.065630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732099e-9dd5-4f45-b587-2b5993c6134d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:51.080843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:51.105857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459192b0-e996-4a32-8f20-f534373a6dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:51.106480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459192b0-e996-4a32-8f20-f534373a6dba None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:51.106757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459192b0-e996-4a32-8f20-f534373a6dba None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:51.107029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459192b0-e996-4a32-8f20-f534373a6dba None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:51.107850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459192b0-e996-4a32-8f20-f534373a6dba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:51.108184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459192b0-e996-4a32-8f20-f534373a6dba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:51.109622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459192b0-e996-4a32-8f20-f534373a6dba None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:51.115126 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 487/966] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 17 16:06:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:51.120704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459192b0-e996-4a32-8f20-f534373a6dba None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:51.139689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083fcf2-1b22-4309-a298-4d1e163626d2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:51.187704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabce06-ba70-42a6-a925-79cba3ec925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:51.188508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabce06-ba70-42a6-a925-79cba3ec925b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:51.188888 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabce06-ba70-42a6-a925-79cba3ec925b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:51.189281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabce06-ba70-42a6-a925-79cba3ec925b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:51.233886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459192b0-e996-4a32-8f20-f534373a6dba None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:51.266376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee8657-6dab-4cbc-a17b-bdea9c63be82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:51.266983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee8657-6dab-4cbc-a17b-bdea9c63be82 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:51.267258 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee8657-6dab-4cbc-a17b-bdea9c63be82 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:51.267526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee8657-6dab-4cbc-a17b-bdea9c63be82 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:51.268151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee8657-6dab-4cbc-a17b-bdea9c63be82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:51.268447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee8657-6dab-4cbc-a17b-bdea9c63be82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:51.269489 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabce06-ba70-42a6-a925-79cba3ec925b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:51.269850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee8657-6dab-4cbc-a17b-bdea9c63be82 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:51.271392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabce06-ba70-42a6-a925-79cba3ec925b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:51.277432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 488/967] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 17 16:06:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:51.277432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfa8e5-f81b-42bd-9aa4-660dda74f296 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:51.277432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfa8e5-f81b-42bd-9aa4-660dda74f296 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:51.277432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfa8e5-f81b-42bd-9aa4-660dda74f296 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:51.282242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 489/968] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:51.283076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfa8e5-f81b-42bd-9aa4-660dda74f296 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:51.286688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:51.347988 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:51.390990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfa8e5-f81b-42bd-9aa4-660dda74f296 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:51.395764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 480/969] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:50 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:06:51.397621 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a66b5-5465-4a7f-87cb-38ec77ea7c2b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:51.397933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a66b5-5465-4a7f-87cb-38ec77ea7c2b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:51.398192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a66b5-5465-4a7f-87cb-38ec77ea7c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:51.415221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-499a66b5-5465-4a7f-87cb-38ec77ea7c2b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:51.416393 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-499a66b5-5465-4a7f-87cb-38ec77ea7c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:51.433827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadb986-b370-47d3-8b12-1ac14b6dd091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:51.434427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb986-b370-47d3-8b12-1ac14b6dd091 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:51.434705 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb986-b370-47d3-8b12-1ac14b6dd091 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:51.434968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadb986-b370-47d3-8b12-1ac14b6dd091 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:51.435613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadb986-b370-47d3-8b12-1ac14b6dd091 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:51.436968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadb986-b370-47d3-8b12-1ac14b6dd091 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:51.486205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 481/970] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:51.487018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a66b5-5465-4a7f-87cb-38ec77ea7c2b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:51.503533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 490/971] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:06:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:51.603355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:51.613677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a66b5-5465-4a7f-87cb-38ec77ea7c2b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:51.659776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45adfd7-7cf4-450f-8aee-d3655e4e5512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:51.660416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45adfd7-7cf4-450f-8aee-d3655e4e5512 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:51.660693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45adfd7-7cf4-450f-8aee-d3655e4e5512 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:51.660962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45adfd7-7cf4-450f-8aee-d3655e4e5512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:51.672060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45adfd7-7cf4-450f-8aee-d3655e4e5512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:51.673538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45adfd7-7cf4-450f-8aee-d3655e4e5512 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-c45adfd7-7cf4-450f-8aee-d3655e4e5512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:51.688855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:51.689892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:51.690799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:51.690799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:51.690799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:51.690799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 482/972] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:51.696752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadb986-b370-47d3-8b12-1ac14b6dd091 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:51.761745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:51.774243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45adfd7-7cf4-450f-8aee-d3655e4e5512 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:51.808286 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadb986-b370-47d3-8b12-1ac14b6dd091 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:51.843053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dafa8-d631-411b-b370-2f49473597c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:51.843663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dafa8-d631-411b-b370-2f49473597c8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:51.843938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dafa8-d631-411b-b370-2f49473597c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:51.844207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dafa8-d631-411b-b370-2f49473597c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:51.844847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dafa8-d631-411b-b370-2f49473597c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:51.845140 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dafa8-d631-411b-b370-2f49473597c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:51.846549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dafa8-d631-411b-b370-2f49473597c8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:51.859197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 491/973] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:51.864248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dafa8-d631-411b-b370-2f49473597c8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:51.888750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45adfd7-7cf4-450f-8aee-d3655e4e5512 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:51.926620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81084b79-dba3-4a45-9636-c8e3646d7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:51.927320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084b79-dba3-4a45-9636-c8e3646d7c10 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:51.927608 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084b79-dba3-4a45-9636-c8e3646d7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:51.927878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084b79-dba3-4a45-9636-c8e3646d7c10 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:51.929140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81084b79-dba3-4a45-9636-c8e3646d7c10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:51.930598 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81084b79-dba3-4a45-9636-c8e3646d7c10 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:51.943054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:51.975283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.sql.core [None req-81084b79-dba3-4a45-9636-c8e3646d7c10 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 16:06:51.975283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 16:06:51.975283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [parameters: {'user_id': '2fceb978a6334de288b6aa95748d0178', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 16:06:51.975283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81777) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 16:06:51.977700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dafa8-d631-411b-b370-2f49473597c8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-81084b79-dba3-4a45-9636-c8e3646d7c10 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result.read() Aug 17 16:06:51.984107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:06:51.985619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application yield resource Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise self.value Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application session.commit() Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 16:06:51.986831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.session.flush() Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application compat.raise_( Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 16:06:51.987971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:06:51.989065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result.read() Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:06:51.990016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [parameters: {'user_id': '2fceb978a6334de288b6aa95748d0178', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:51.991883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 16:06:51.992786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 16:06:51.993802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 16:06:51.993802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 16:06:51.993802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 16:06:51.993802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 16:06:51.993802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 16:06:51.993802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:51.993802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 483/974] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 17 16:06:51 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:51.993802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81084b79-dba3-4a45-9636-c8e3646d7c10 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:52.015190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:52.033033 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5c2fc-26ab-476c-89bd-73704b9269cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:52.033704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5c2fc-26ab-476c-89bd-73704b9269cd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:52.033984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5c2fc-26ab-476c-89bd-73704b9269cd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:52.034254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5c2fc-26ab-476c-89bd-73704b9269cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:52.043097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5c2fc-26ab-476c-89bd-73704b9269cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:52.044984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5c2fc-26ab-476c-89bd-73704b9269cd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a1e5c2fc-26ab-476c-89bd-73704b9269cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:52.061178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:52.062372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:52.063355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:52.063355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:52.063355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:52.063355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:52.063355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:52.063355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:52.063355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:52.063355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:52.065443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 492/975] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:52.069656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5c2fc-26ab-476c-89bd-73704b9269cd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:52.129426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81084b79-dba3-4a45-9636-c8e3646d7c10 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:52.170010 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d8672-73fb-4a3b-b4ce-8361d6db7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:52.170898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8672-73fb-4a3b-b4ce-8361d6db7e4b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:52.171327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8672-73fb-4a3b-b4ce-8361d6db7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:52.171799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8672-73fb-4a3b-b4ce-8361d6db7e4b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:52.181531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d8672-73fb-4a3b-b4ce-8361d6db7e4b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:52.183460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d8672-73fb-4a3b-b4ce-8361d6db7e4b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:52.194209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5c2fc-26ab-476c-89bd-73704b9269cd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-ae3d8672-73fb-4a3b-b4ce-8361d6db7e4b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:52.196765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:52.197983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:52.199061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:52.199061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:52.199061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:52.199061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:52.199061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:52.199061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:52.199061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:52.199061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:52.199061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:06:52.199061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:52.201176 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 484/976] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:52.206493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d8672-73fb-4a3b-b4ce-8361d6db7e4b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:52.233298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93dc7a-f3b4-4d62-9458-5e3a201f768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:52.234190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93dc7a-f3b4-4d62-9458-5e3a201f768d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:52.234618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93dc7a-f3b4-4d62-9458-5e3a201f768d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:52.235053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93dc7a-f3b4-4d62-9458-5e3a201f768d None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:52.235945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93dc7a-f3b4-4d62-9458-5e3a201f768d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:52.236409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93dc7a-f3b4-4d62-9458-5e3a201f768d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:52.238046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93dc7a-f3b4-4d62-9458-5e3a201f768d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:52.251903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 493/977] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:52.257730 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93dc7a-f3b4-4d62-9458-5e3a201f768d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:52.282596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:52.303871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:52.336341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d8672-73fb-4a3b-b4ce-8361d6db7e4b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:52.367667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93dc7a-f3b4-4d62-9458-5e3a201f768d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:52.374483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12dc59-dc40-4b04-a452-f0ba69c30750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:52.375098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12dc59-dc40-4b04-a452-f0ba69c30750 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:52.375373 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12dc59-dc40-4b04-a452-f0ba69c30750 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:52.375638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12dc59-dc40-4b04-a452-f0ba69c30750 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:52.376594 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12dc59-dc40-4b04-a452-f0ba69c30750 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:52.376594 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12dc59-dc40-4b04-a452-f0ba69c30750 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:52.378051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12dc59-dc40-4b04-a452-f0ba69c30750 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:52.405878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40f399-5f79-4a80-8df9-ff74f4aa2903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:52.406797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f399-5f79-4a80-8df9-ff74f4aa2903 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:52.407227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f399-5f79-4a80-8df9-ff74f4aa2903 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:52.407646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40f399-5f79-4a80-8df9-ff74f4aa2903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:52.408632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40f399-5f79-4a80-8df9-ff74f4aa2903 None admin] RBAC: Adding query filter params (role.id=2ab4ea75bfa748869c320610d3ca5088, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=666d255c72394f4e9faaeb5b94253cf1) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:52.409110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40f399-5f79-4a80-8df9-ff74f4aa2903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:52.410748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40f399-5f79-4a80-8df9-ff74f4aa2903 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:52.417899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 485/978] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 17 16:06:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:52.418873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 494/979] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:52 2022] GET /identity/v3/role_assignments?user.id=666d255c72394f4e9faaeb5b94253cf1&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2ab4ea75bfa748869c320610d3ca5088 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:53.026377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585da20-a3ce-4515-bcfa-185bba21d21d None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:53.026377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585da20-a3ce-4515-bcfa-185bba21d21d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:53.026377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585da20-a3ce-4515-bcfa-185bba21d21d None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:53.028277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 486/980] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:53.033311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9154c4-245d-4d13-ba6e-ba4ee10a6f37 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:53.033745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9154c4-245d-4d13-ba6e-ba4ee10a6f37 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:53.033916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9154c4-245d-4d13-ba6e-ba4ee10a6f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:53.052006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fb9154c4-245d-4d13-ba6e-ba4ee10a6f37 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:53.053302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fb9154c4-245d-4d13-ba6e-ba4ee10a6f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:53.122924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 495/981] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:53.393162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585da20-a3ce-4515-bcfa-185bba21d21d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:53.499697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585da20-a3ce-4515-bcfa-185bba21d21d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:53.517643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:53.528392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51da85-6268-4fdd-ac5e-f39be600aca4 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:53.528677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51da85-6268-4fdd-ac5e-f39be600aca4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:53.528951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51da85-6268-4fdd-ac5e-f39be600aca4 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:53.530408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 496/982] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:53.536047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494e98f-f997-427a-ad15-da5e3cf1e007 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:53.540189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494e98f-f997-427a-ad15-da5e3cf1e007 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:53.540328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f74a9-0232-433c-af36-99fedd309cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:53.540458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494e98f-f997-427a-ad15-da5e3cf1e007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:53.540555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f74a9-0232-433c-af36-99fedd309cbc None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:53.540555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f74a9-0232-433c-af36-99fedd309cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:53.540555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f74a9-0232-433c-af36-99fedd309cbc None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:53.540555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f74a9-0232-433c-af36-99fedd309cbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:53.540555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f74a9-0232-433c-af36-99fedd309cbc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:53.556656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9494e98f-f997-427a-ad15-da5e3cf1e007 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:53.557878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9494e98f-f997-427a-ad15-da5e3cf1e007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:53.584454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:53.622165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 487/983] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:06:53 2022] POST /identity/v3/services => generated 242 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:53.638395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 497/984] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:53.908115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f74a9-0232-433c-af36-99fedd309cbc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:54.012966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f74a9-0232-433c-af36-99fedd309cbc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:54.048279 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694917-04e6-4a54-9b05-5981737aa377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:54.048959 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694917-04e6-4a54-9b05-5981737aa377 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:54.049179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694917-04e6-4a54-9b05-5981737aa377 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:54.049534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694917-04e6-4a54-9b05-5981737aa377 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:54.050127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e694917-04e6-4a54-9b05-5981737aa377 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:54.051490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e694917-04e6-4a54-9b05-5981737aa377 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-2e694917-04e6-4a54-9b05-5981737aa377 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:54.060592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:54.061692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:54.062631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:54.065447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 488/985] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 17 16:06:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:54.067929 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494e98f-f997-427a-ad15-da5e3cf1e007 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:54.171218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494e98f-f997-427a-ad15-da5e3cf1e007 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:54.205216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0e08e-5676-4ba5-b234-a40cf3693c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:54.205844 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0e08e-5676-4ba5-b234-a40cf3693c4e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:54.206121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0e08e-5676-4ba5-b234-a40cf3693c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:54.206392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0e08e-5676-4ba5-b234-a40cf3693c4e None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:54.207012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0e08e-5676-4ba5-b234-a40cf3693c4e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:54.207309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0e08e-5676-4ba5-b234-a40cf3693c4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:54.208677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0e08e-5676-4ba5-b234-a40cf3693c4e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:54.214426 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 498/986] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 17 16:06:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:54.219958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694917-04e6-4a54-9b05-5981737aa377 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:54.264770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:54.323384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694917-04e6-4a54-9b05-5981737aa377 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:54.357247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bb857-52fb-411a-beec-07ddfc87da37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:54.357957 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bb857-52fb-411a-beec-07ddfc87da37 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:54.358236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bb857-52fb-411a-beec-07ddfc87da37 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:54.358505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bb857-52fb-411a-beec-07ddfc87da37 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:54.359124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bb857-52fb-411a-beec-07ddfc87da37 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:54.359419 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bb857-52fb-411a-beec-07ddfc87da37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:54.360780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bb857-52fb-411a-beec-07ddfc87da37 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:54.365872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 489/987] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 17 16:06:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:54.367907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dbaef-a522-4397-b2a7-024204711f4d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:54.368196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dbaef-a522-4397-b2a7-024204711f4d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:54.368469 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dbaef-a522-4397-b2a7-024204711f4d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:54.370117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 499/988] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:54.371302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bb857-52fb-411a-beec-07ddfc87da37 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:54.376553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edf91f-2ab2-40e1-85d2-70989fa713f8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:54.376832 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edf91f-2ab2-40e1-85d2-70989fa713f8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:54.377158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edf91f-2ab2-40e1-85d2-70989fa713f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:54.395529 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-11edf91f-2ab2-40e1-85d2-70989fa713f8 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:54.397334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-11edf91f-2ab2-40e1-85d2-70989fa713f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:54.414767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:54.467966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 500/989] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:54.483435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bb857-52fb-411a-beec-07ddfc87da37 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:54.492992 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:54.519655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7436fc9-bf92-4963-abbe-98c9d5737241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:54.520284 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7436fc9-bf92-4963-abbe-98c9d5737241 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:54.520644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7436fc9-bf92-4963-abbe-98c9d5737241 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:54.520952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7436fc9-bf92-4963-abbe-98c9d5737241 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:54.522252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7436fc9-bf92-4963-abbe-98c9d5737241 None admin] RBAC: Adding query filter params (interface=admin, service_id=e75ca65f831848ad8932da4a241c3a2f, region_id=RegionOne) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:54.522561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7436fc9-bf92-4963-abbe-98c9d5737241 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:54.523911 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7436fc9-bf92-4963-abbe-98c9d5737241 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:54.534905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edf91f-2ab2-40e1-85d2-70989fa713f8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:54.535643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 490/990] 10.222.0.40 () {56 vars in 1249 bytes} [Wed Aug 17 16:06:54 2022] GET /identity/v3/endpoints?service_id=e75ca65f831848ad8932da4a241c3a2f&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:54.633449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edf91f-2ab2-40e1-85d2-70989fa713f8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:54.666515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598098ad-5766-49b4-8d76-84108c866eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:54.667119 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598098ad-5766-49b4-8d76-84108c866eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:54.667394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598098ad-5766-49b4-8d76-84108c866eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:54.667662 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598098ad-5766-49b4-8d76-84108c866eb7 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:54.668263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598098ad-5766-49b4-8d76-84108c866eb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:54.669663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598098ad-5766-49b4-8d76-84108c866eb7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:54.675942 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 501/991] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 17 16:06:54 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:06:54.744954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7436fc9-bf92-4963-abbe-98c9d5737241 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:54.853846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7436fc9-bf92-4963-abbe-98c9d5737241 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:54.889989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38170640-e28b-4fe4-ba07-de7df7b46220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:54.890628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170640-e28b-4fe4-ba07-de7df7b46220 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:54.890903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170640-e28b-4fe4-ba07-de7df7b46220 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:54.891169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170640-e28b-4fe4-ba07-de7df7b46220 None admin] PATH_INFO: `/v3/services/image` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:54.891749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38170640-e28b-4fe4-ba07-de7df7b46220 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:54.893103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38170640-e28b-4fe4-ba07-de7df7b46220 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-38170640-e28b-4fe4-ba07-de7df7b46220 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:54.902053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:54.903028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:54.903905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 491/992] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 17 16:06:54 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:54.910611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598098ad-5766-49b4-8d76-84108c866eb7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:54.932419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:55.016729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598098ad-5766-49b4-8d76-84108c866eb7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:55.054512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38ace7-c73a-42ea-b2b7-8bb518735046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:55.055124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38ace7-c73a-42ea-b2b7-8bb518735046 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:55.055405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38ace7-c73a-42ea-b2b7-8bb518735046 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:55.055674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38ace7-c73a-42ea-b2b7-8bb518735046 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:55.056300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38ace7-c73a-42ea-b2b7-8bb518735046 None admin] RBAC: Adding query filter params (name=image) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:55.056597 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38ace7-c73a-42ea-b2b7-8bb518735046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:55.057997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38ace7-c73a-42ea-b2b7-8bb518735046 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:55.067754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 502/993] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:55.069586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38170640-e28b-4fe4-ba07-de7df7b46220 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:55.106616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:55.176223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38170640-e28b-4fe4-ba07-de7df7b46220 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:55.211475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34bc5e-ea15-4ac9-aa55-347e3c527ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:55.212085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34bc5e-ea15-4ac9-aa55-347e3c527ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:55.212363 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34bc5e-ea15-4ac9-aa55-347e3c527ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:55.212631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34bc5e-ea15-4ac9-aa55-347e3c527ba2 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:55.213261 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34bc5e-ea15-4ac9-aa55-347e3c527ba2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:55.213591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34bc5e-ea15-4ac9-aa55-347e3c527ba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:55.214956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34bc5e-ea15-4ac9-aa55-347e3c527ba2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:55.219571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 492/994] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:55.549447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179331d7-4c63-4c7d-b138-9d1016be65da None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:55.549995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179331d7-4c63-4c7d-b138-9d1016be65da None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:55.549995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179331d7-4c63-4c7d-b138-9d1016be65da None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:55.551454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 503/995] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:55.556479 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3cea0-f6a9-498f-a214-03536532e745 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:55.556768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3cea0-f6a9-498f-a214-03536532e745 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:55.557040 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3cea0-f6a9-498f-a214-03536532e745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:55.575411 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e6b3cea0-f6a9-498f-a214-03536532e745 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:55.576923 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e6b3cea0-f6a9-498f-a214-03536532e745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:55.647530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 493/996] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:55.914280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179331d7-4c63-4c7d-b138-9d1016be65da None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:55.998169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:56.017244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179331d7-4c63-4c7d-b138-9d1016be65da None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:56.051505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308e3ff-bf7d-45c8-8173-575fb67d68a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:56.052135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308e3ff-bf7d-45c8-8173-575fb67d68a7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:56.052413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308e3ff-bf7d-45c8-8173-575fb67d68a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:56.052685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308e3ff-bf7d-45c8-8173-575fb67d68a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:56.053293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308e3ff-bf7d-45c8-8173-575fb67d68a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:56.054710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308e3ff-bf7d-45c8-8173-575fb67d68a7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-1308e3ff-bf7d-45c8-8173-575fb67d68a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:56.063459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:56.064466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:06:56.065316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:56.066738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 504/997] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:56.071179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3cea0-f6a9-498f-a214-03536532e745 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:56.100062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:56.172173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3cea0-f6a9-498f-a214-03536532e745 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:56.207504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e54464-6f71-41c9-92ce-f391509802c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:56.208124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54464-6f71-41c9-92ce-f391509802c6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:56.208399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54464-6f71-41c9-92ce-f391509802c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:56.208669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54464-6f71-41c9-92ce-f391509802c6 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:56.209947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e54464-6f71-41c9-92ce-f391509802c6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:56.210399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e54464-6f71-41c9-92ce-f391509802c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:56.211761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e54464-6f71-41c9-92ce-f391509802c6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:56.216814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 494/998] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:56.222686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308e3ff-bf7d-45c8-8173-575fb67d68a7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:56.328887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308e3ff-bf7d-45c8-8173-575fb67d68a7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:56.362720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970fd8f-e196-49a4-bcaf-21748996e695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:56.363332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970fd8f-e196-49a4-bcaf-21748996e695 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:56.363608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970fd8f-e196-49a4-bcaf-21748996e695 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:56.363877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970fd8f-e196-49a4-bcaf-21748996e695 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:56.364503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970fd8f-e196-49a4-bcaf-21748996e695 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:56.364800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970fd8f-e196-49a4-bcaf-21748996e695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:56.366744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970fd8f-e196-49a4-bcaf-21748996e695 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:56.376358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 505/999] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:56.377481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e54464-6f71-41c9-92ce-f391509802c6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:56.469285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:56.478446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e54464-6f71-41c9-92ce-f391509802c6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:56.512193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd07d7-26e0-4cd6-96e3-16440dcc00c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:56.512822 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd07d7-26e0-4cd6-96e3-16440dcc00c8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:56.513075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd07d7-26e0-4cd6-96e3-16440dcc00c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:56.513343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd07d7-26e0-4cd6-96e3-16440dcc00c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:56.514058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd07d7-26e0-4cd6-96e3-16440dcc00c8 None admin] RBAC: Adding query filter params (interface=public, service_id=1bf28354e618422e829b74f74ec370ae, region_id=RegionOne) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:56.514362 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd07d7-26e0-4cd6-96e3-16440dcc00c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:56.515947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd07d7-26e0-4cd6-96e3-16440dcc00c8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:56.525869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 495/1000] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 17 16:06:56 2022] GET /identity/v3/endpoints?service_id=1bf28354e618422e829b74f74ec370ae&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:56.527153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970fd8f-e196-49a4-bcaf-21748996e695 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:56.540129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:56.586567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06796704-3645-4770-bc1c-caebcc892040 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:56.587225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06796704-3645-4770-bc1c-caebcc892040 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:56.587508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06796704-3645-4770-bc1c-caebcc892040 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:56.589565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 496/1001] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:06:56.594763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0734-aa09-472c-a9a8-bb637c11daed None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:56.595044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0734-aa09-472c-a9a8-bb637c11daed None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:56.595314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0734-aa09-472c-a9a8-bb637c11daed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:56.620085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-90ec0734-aa09-472c-a9a8-bb637c11daed None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:56.621269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-90ec0734-aa09-472c-a9a8-bb637c11daed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:56.637962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970fd8f-e196-49a4-bcaf-21748996e695 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:56.673444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2d805-2697-4097-ac43-2b3b1059c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:56.674052 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d805-2697-4097-ac43-2b3b1059c48d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:56.674326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d805-2697-4097-ac43-2b3b1059c48d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:56.674593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d805-2697-4097-ac43-2b3b1059c48d None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:56.675196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2d805-2697-4097-ac43-2b3b1059c48d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:56.676563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2d805-2697-4097-ac43-2b3b1059c48d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:56.683834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 506/1002] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 17 16:06:56 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:06:56.705069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 497/1003] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:56.972085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2d805-2697-4097-ac43-2b3b1059c48d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:57.051341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:57.077643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2d805-2697-4097-ac43-2b3b1059c48d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:57.112931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78666b2-edef-4ffb-a2e4-5b6fbea791bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:57.113588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78666b2-edef-4ffb-a2e4-5b6fbea791bd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:57.113928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78666b2-edef-4ffb-a2e4-5b6fbea791bd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:57.114198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78666b2-edef-4ffb-a2e4-5b6fbea791bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:57.114776 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78666b2-edef-4ffb-a2e4-5b6fbea791bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:57.116357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78666b2-edef-4ffb-a2e4-5b6fbea791bd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b78666b2-edef-4ffb-a2e4-5b6fbea791bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:57.125199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:57.126246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:06:57.127098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:06:57.129448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 507/1004] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 17 16:06:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:57.132518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0734-aa09-472c-a9a8-bb637c11daed None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:57.149105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba8e6-4a37-4530-bd5d-e993290f604a None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:57.149533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba8e6-4a37-4530-bd5d-e993290f604a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:57.149809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba8e6-4a37-4530-bd5d-e993290f604a None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:57.151744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 508/1005] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:06:57.156430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15911-1f69-4da6-810e-7fe35da04153 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:57.156706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15911-1f69-4da6-810e-7fe35da04153 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:57.156976 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15911-1f69-4da6-810e-7fe35da04153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:57.175883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a0a15911-1f69-4da6-810e-7fe35da04153 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:57.177056 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a0a15911-1f69-4da6-810e-7fe35da04153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:57.232029 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:57.246662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0734-aa09-472c-a9a8-bb637c11daed None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:57.249423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 509/1006] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:57.282507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f23c99-4c0c-43e7-a306-af1e628660aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:57.283114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f23c99-4c0c-43e7-a306-af1e628660aa None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:57.283387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f23c99-4c0c-43e7-a306-af1e628660aa None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:57.283654 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f23c99-4c0c-43e7-a306-af1e628660aa None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:57.284279 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f23c99-4c0c-43e7-a306-af1e628660aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:57.284576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f23c99-4c0c-43e7-a306-af1e628660aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:57.285973 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f23c99-4c0c-43e7-a306-af1e628660aa None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:57.296005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 498/1007] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 17 16:06:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:57.297127 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a15911-1f69-4da6-810e-7fe35da04153 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:57.364263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:57.399225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a15911-1f69-4da6-810e-7fe35da04153 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:57.432317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eebdb-1e7e-4aca-a8ae-ad597228d73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:57.432857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eebdb-1e7e-4aca-a8ae-ad597228d73b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:57.433131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eebdb-1e7e-4aca-a8ae-ad597228d73b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:57.433423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eebdb-1e7e-4aca-a8ae-ad597228d73b None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:57.434106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eebdb-1e7e-4aca-a8ae-ad597228d73b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:57.434404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eebdb-1e7e-4aca-a8ae-ad597228d73b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:57.435827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eebdb-1e7e-4aca-a8ae-ad597228d73b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:57.446083 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 510/1008] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 17 16:06:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:57.447333 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f23c99-4c0c-43e7-a306-af1e628660aa None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:57.516591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eebdb-1e7e-4aca-a8ae-ad597228d73b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:57.548236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f23c99-4c0c-43e7-a306-af1e628660aa None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:57.585069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de8c01-030f-421a-88e8-bfcb1e8d7c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:57.585703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de8c01-030f-421a-88e8-bfcb1e8d7c93 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:57.585971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de8c01-030f-421a-88e8-bfcb1e8d7c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:57.586238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de8c01-030f-421a-88e8-bfcb1e8d7c93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:57.586884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de8c01-030f-421a-88e8-bfcb1e8d7c93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:57.588237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de8c01-030f-421a-88e8-bfcb1e8d7c93 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:57.627988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eebdb-1e7e-4aca-a8ae-ad597228d73b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:57.659588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:57.669839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 499/1009] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:06:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:06:57.672211 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741f3d-9e59-43e2-bb9d-010b31614a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:57.672900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741f3d-9e59-43e2-bb9d-010b31614a2a None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:57.673177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741f3d-9e59-43e2-bb9d-010b31614a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:57.673523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741f3d-9e59-43e2-bb9d-010b31614a2a None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:57.674208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741f3d-9e59-43e2-bb9d-010b31614a2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:57.675824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741f3d-9e59-43e2-bb9d-010b31614a2a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:57.773555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 511/1010] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:06:57 2022] POST /identity/v3/services => generated 242 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:06:58.615739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62b38a-e0c3-43a5-a5d2-bbd519e7d173 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:58.616290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62b38a-e0c3-43a5-a5d2-bbd519e7d173 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:58.616570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62b38a-e0c3-43a5-a5d2-bbd519e7d173 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:58.618025 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 500/1011] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:58.623063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329f8cb-0023-44ae-81fb-6f13d59fff94 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:58.623414 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329f8cb-0023-44ae-81fb-6f13d59fff94 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:58.623785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329f8cb-0023-44ae-81fb-6f13d59fff94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:58.642713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e329f8cb-0023-44ae-81fb-6f13d59fff94 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:58.643896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e329f8cb-0023-44ae-81fb-6f13d59fff94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:58.721400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 512/1012] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:58 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:58.988878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62b38a-e0c3-43a5-a5d2-bbd519e7d173 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:59.003143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:59.095882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62b38a-e0c3-43a5-a5d2-bbd519e7d173 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:59.131518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0251d5-bd2f-4f33-8ba8-a11b6b9da45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:59.132151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0251d5-bd2f-4f33-8ba8-a11b6b9da45e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:59.132488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0251d5-bd2f-4f33-8ba8-a11b6b9da45e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:59.132764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0251d5-bd2f-4f33-8ba8-a11b6b9da45e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:59.133352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0251d5-bd2f-4f33-8ba8-a11b6b9da45e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:59.134743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0251d5-bd2f-4f33-8ba8-a11b6b9da45e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-bb0251d5-bd2f-4f33-8ba8-a11b6b9da45e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:59.143737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:59.144742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:06:59.145627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:06:59.149713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 501/1013] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:59.153312 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329f8cb-0023-44ae-81fb-6f13d59fff94 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:59.253545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329f8cb-0023-44ae-81fb-6f13d59fff94 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:59.268000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:59.289292 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4eb34-86ee-42cc-b58e-bb742ac53436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:59.289884 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4eb34-86ee-42cc-b58e-bb742ac53436 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:59.290164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4eb34-86ee-42cc-b58e-bb742ac53436 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:59.290436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4eb34-86ee-42cc-b58e-bb742ac53436 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:59.291065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4eb34-86ee-42cc-b58e-bb742ac53436 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:59.291363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4eb34-86ee-42cc-b58e-bb742ac53436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:59.292744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4eb34-86ee-42cc-b58e-bb742ac53436 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:59.302174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 513/1014] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:59.303970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0251d5-bd2f-4f33-8ba8-a11b6b9da45e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:59.384954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:59.410336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0251d5-bd2f-4f33-8ba8-a11b6b9da45e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:59.446022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f15a37-8f42-48f0-8ecb-7b43e9582e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:59.446643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f15a37-8f42-48f0-8ecb-7b43e9582e84 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:59.446921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f15a37-8f42-48f0-8ecb-7b43e9582e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:59.447190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f15a37-8f42-48f0-8ecb-7b43e9582e84 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:59.447820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f15a37-8f42-48f0-8ecb-7b43e9582e84 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:59.448120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f15a37-8f42-48f0-8ecb-7b43e9582e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:59.449509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f15a37-8f42-48f0-8ecb-7b43e9582e84 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:59.457726 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 502/1015] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 17 16:06:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:59.460863 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4eb34-86ee-42cc-b58e-bb742ac53436 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:59.563475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4eb34-86ee-42cc-b58e-bb742ac53436 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:59.583263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f218047-a8ec-41d8-9021-4e3b1fce945e None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:59.583541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f218047-a8ec-41d8-9021-4e3b1fce945e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:59.583874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f218047-a8ec-41d8-9021-4e3b1fce945e None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:59.585742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 503/1016] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:06:59.590739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99dc17-3524-49ca-8e6d-8e58e33fd86e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:59.591237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99dc17-3524-49ca-8e6d-8e58e33fd86e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:59.591795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99dc17-3524-49ca-8e6d-8e58e33fd86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:59.599553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3122e-0dfa-4c08-8844-231a66140340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:59.600176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3122e-0dfa-4c08-8844-231a66140340 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:59.600450 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3122e-0dfa-4c08-8844-231a66140340 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:59.600724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3122e-0dfa-4c08-8844-231a66140340 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:59.601405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3122e-0dfa-4c08-8844-231a66140340 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:59.602781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3122e-0dfa-4c08-8844-231a66140340 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:59.611104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1a99dc17-3524-49ca-8e6d-8e58e33fd86e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:59.612879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1a99dc17-3524-49ca-8e6d-8e58e33fd86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:59.669692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 514/1017] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:06:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:59.690415 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785afa3-1dc1-4bb5-bbac-64ad4c10cd00 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:59.690701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785afa3-1dc1-4bb5-bbac-64ad4c10cd00 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:59.692972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785afa3-1dc1-4bb5-bbac-64ad4c10cd00 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:59.692972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 515/1018] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:06:59.694634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 504/1019] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:06:59.698852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef43f4-8b6a-413a-8163-418d90566e11 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:59.699123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef43f4-8b6a-413a-8163-418d90566e11 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:59.699395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef43f4-8b6a-413a-8163-418d90566e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:59.719863 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0aef43f4-8b6a-413a-8163-418d90566e11 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:59.721062 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0aef43f4-8b6a-413a-8163-418d90566e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:59.750652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:59.801282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 516/1020] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:59.969330 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99dc17-3524-49ca-8e6d-8e58e33fd86e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:00.028147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:00.064779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef43f4-8b6a-413a-8163-418d90566e11 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:00.067516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99dc17-3524-49ca-8e6d-8e58e33fd86e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:00.104288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3ab0b-65ed-4602-95a9-e7df54a34f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:00.104926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3ab0b-65ed-4602-95a9-e7df54a34f0a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:00.105202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3ab0b-65ed-4602-95a9-e7df54a34f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:00.105513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3ab0b-65ed-4602-95a9-e7df54a34f0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:00.106621 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3ab0b-65ed-4602-95a9-e7df54a34f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:00.108056 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3ab0b-65ed-4602-95a9-e7df54a34f0a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:00.109838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 505/1021] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:00.115793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3ab0b-65ed-4602-95a9-e7df54a34f0a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:00.171745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef43f4-8b6a-413a-8163-418d90566e11 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:00.207677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e833a-6fb9-4550-8a2f-e7e51ab915e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:00.208307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e833a-6fb9-4550-8a2f-e7e51ab915e2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:00.208583 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e833a-6fb9-4550-8a2f-e7e51ab915e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:00.209002 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e833a-6fb9-4550-8a2f-e7e51ab915e2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:00.210224 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e833a-6fb9-4550-8a2f-e7e51ab915e2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:00.211131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e833a-6fb9-4550-8a2f-e7e51ab915e2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e63e833a-6fb9-4550-8a2f-e7e51ab915e2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:00.219855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:00.221051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:00.222139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 517/1022] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 17 16:07:00 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:07:00.226629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e833a-6fb9-4550-8a2f-e7e51ab915e2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:00.227469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3ab0b-65ed-4602-95a9-e7df54a34f0a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:00.259781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:00.261714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:00.265340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928f2f9-b9ee-4f9f-9ef4-31faaf1a6dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:00.265974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928f2f9-b9ee-4f9f-9ef4-31faaf1a6dc7 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:00.266248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928f2f9-b9ee-4f9f-9ef4-31faaf1a6dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:00.266544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928f2f9-b9ee-4f9f-9ef4-31faaf1a6dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:00.267196 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928f2f9-b9ee-4f9f-9ef4-31faaf1a6dc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:00.268605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928f2f9-b9ee-4f9f-9ef4-31faaf1a6dc7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:00.333438 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 506/1023] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:07:00 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:07:00.341024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e833a-6fb9-4550-8a2f-e7e51ab915e2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:00.382693 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e8119-0a6f-493e-b93c-787234f52084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:00.383588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8119-0a6f-493e-b93c-787234f52084 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:00.384047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8119-0a6f-493e-b93c-787234f52084 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:00.385996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8119-0a6f-493e-b93c-787234f52084 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:00.385996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e8119-0a6f-493e-b93c-787234f52084 None admin] RBAC: Adding query filter params (name=image) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:00.385996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e8119-0a6f-493e-b93c-787234f52084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:00.387041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e8119-0a6f-493e-b93c-787234f52084 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:00.397886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 518/1024] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:00.399226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928f2f9-b9ee-4f9f-9ef4-31faaf1a6dc7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:00.507766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928f2f9-b9ee-4f9f-9ef4-31faaf1a6dc7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:00.543153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ac196-0058-4131-b6c8-044f91322f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:00.543756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ac196-0058-4131-b6c8-044f91322f3c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:00.544027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ac196-0058-4131-b6c8-044f91322f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:00.544297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ac196-0058-4131-b6c8-044f91322f3c None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:00.544912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ac196-0058-4131-b6c8-044f91322f3c None admin] RBAC: Adding query filter params (type=image) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:00.545204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ac196-0058-4131-b6c8-044f91322f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:00.546592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ac196-0058-4131-b6c8-044f91322f3c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:00.551914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 507/1025] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:00.558638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e8119-0a6f-493e-b93c-787234f52084 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:00.652122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:00.661171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e8119-0a6f-493e-b93c-787234f52084 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:00.697061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa038c2-c235-4d58-ba0c-a5f035251d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:00.697711 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa038c2-c235-4d58-ba0c-a5f035251d4f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:00.697986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa038c2-c235-4d58-ba0c-a5f035251d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:00.698256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa038c2-c235-4d58-ba0c-a5f035251d4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:00.698977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa038c2-c235-4d58-ba0c-a5f035251d4f None admin] RBAC: Adding query filter params (interface=public, service_id=70dd75a7e6354a62a64abf56f2761404, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:00.699297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa038c2-c235-4d58-ba0c-a5f035251d4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:00.700665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa038c2-c235-4d58-ba0c-a5f035251d4f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:00.706029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 519/1026] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 17 16:07:00 2022] GET /identity/v3/endpoints?service_id=70dd75a7e6354a62a64abf56f2761404&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:00.712462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ac196-0058-4131-b6c8-044f91322f3c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:00.764683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:00.817687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ac196-0058-4131-b6c8-044f91322f3c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:00.856805 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65ff41-d547-4dad-8d94-5471b7f4324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:00.857443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65ff41-d547-4dad-8d94-5471b7f4324b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:00.857721 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65ff41-d547-4dad-8d94-5471b7f4324b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:00.857986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65ff41-d547-4dad-8d94-5471b7f4324b None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:00.858588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65ff41-d547-4dad-8d94-5471b7f4324b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:00.859939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65ff41-d547-4dad-8d94-5471b7f4324b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:00.873388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 508/1027] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 17 16:07:00 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:07:01.671380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fcb4a-c8af-47ce-9787-3a334d78ebce None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:01.671906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fcb4a-c8af-47ce-9787-3a334d78ebce None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:01.671906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fcb4a-c8af-47ce-9787-3a334d78ebce None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:01.673265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 520/1028] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:01.679064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503b14-39ab-4f29-80ef-924c87783058 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:01.679351 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503b14-39ab-4f29-80ef-924c87783058 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:01.679624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8503b14-39ab-4f29-80ef-924c87783058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:01.698353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c8503b14-39ab-4f29-80ef-924c87783058 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:01.699535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c8503b14-39ab-4f29-80ef-924c87783058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:01.767388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 509/1029] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:02.039912 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fcb4a-c8af-47ce-9787-3a334d78ebce None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:02.149801 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fcb4a-c8af-47ce-9787-3a334d78ebce None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:02.183671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aacbf1-3dea-48c0-9368-d1b539a0c16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:02.184302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aacbf1-3dea-48c0-9368-d1b539a0c16c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:02.184580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aacbf1-3dea-48c0-9368-d1b539a0c16c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:02.184849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aacbf1-3dea-48c0-9368-d1b539a0c16c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:02.196075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aacbf1-3dea-48c0-9368-d1b539a0c16c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-75aacbf1-3dea-48c0-9368-d1b539a0c16c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:02.200778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:02.201780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:02.202646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 521/1030] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 17 16:07:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:02.207841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8503b14-39ab-4f29-80ef-924c87783058 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:02.253875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:02.285816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559dd2a-9b54-42eb-aae2-f9a79c74d31f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:02.286126 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559dd2a-9b54-42eb-aae2-f9a79c74d31f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:02.286371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559dd2a-9b54-42eb-aae2-f9a79c74d31f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:02.289481 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 522/1031] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:07:02.293708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a805e8-5e7c-4631-956c-5326f8131790 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:02.293931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a805e8-5e7c-4631-956c-5326f8131790 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:02.294205 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a805e8-5e7c-4631-956c-5326f8131790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:02.312574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8503b14-39ab-4f29-80ef-924c87783058 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:02.314044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d6a805e8-5e7c-4631-956c-5326f8131790 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:02.315244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d6a805e8-5e7c-4631-956c-5326f8131790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:02.327216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:02.351245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2dc2-0b50-420b-8cdd-fe80857eaf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:02.351875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2dc2-0b50-420b-8cdd-fe80857eaf05 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:02.352130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2dc2-0b50-420b-8cdd-fe80857eaf05 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:02.352396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2dc2-0b50-420b-8cdd-fe80857eaf05 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:02.353315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa2dc2-0b50-420b-8cdd-fe80857eaf05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:02.353518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa2dc2-0b50-420b-8cdd-fe80857eaf05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:02.354736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa2dc2-0b50-420b-8cdd-fe80857eaf05 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:02.368247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 510/1032] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 17 16:07:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:02.369407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2dc2-0b50-420b-8cdd-fe80857eaf05 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:02.391135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 523/1033] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:07:02.471499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2dc2-0b50-420b-8cdd-fe80857eaf05 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:02.473833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:02.507072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78b024-69f8-4ac9-9ab1-aaa0cd45d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:02.507691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78b024-69f8-4ac9-9ab1-aaa0cd45d523 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:02.507966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78b024-69f8-4ac9-9ab1-aaa0cd45d523 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:02.508234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78b024-69f8-4ac9-9ab1-aaa0cd45d523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:02.518597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78b024-69f8-4ac9-9ab1-aaa0cd45d523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:02.520042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78b024-69f8-4ac9-9ab1-aaa0cd45d523 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-5a78b024-69f8-4ac9-9ab1-aaa0cd45d523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:07:02.534868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:02.535817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:07:02.536767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:07:02.536767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:02.536767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:02.541147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 511/1034] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:07:02.542372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a805e8-5e7c-4631-956c-5326f8131790 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:02.643266 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a805e8-5e7c-4631-956c-5326f8131790 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:02.665851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78b024-69f8-4ac9-9ab1-aaa0cd45d523 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:02.680918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a4544-1723-46fa-aec5-03674e6f3bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:02.681548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4544-1723-46fa-aec5-03674e6f3bba None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:02.681824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4544-1723-46fa-aec5-03674e6f3bba None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:02.682093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4544-1723-46fa-aec5-03674e6f3bba None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:02.682734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a4544-1723-46fa-aec5-03674e6f3bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:02.683029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a4544-1723-46fa-aec5-03674e6f3bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:02.684389 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a4544-1723-46fa-aec5-03674e6f3bba None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:02.697877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 524/1035] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:02.703988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a4544-1723-46fa-aec5-03674e6f3bba None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:02.714079 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:02.784912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78b024-69f8-4ac9-9ab1-aaa0cd45d523 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:02.808082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a4544-1723-46fa-aec5-03674e6f3bba None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:02.819004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0b8cb-b6e0-4c19-8249-50150ca5aec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:02.819625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0b8cb-b6e0-4c19-8249-50150ca5aec7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:02.819896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0b8cb-b6e0-4c19-8249-50150ca5aec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:02.820158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0b8cb-b6e0-4c19-8249-50150ca5aec7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:02.821250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0b8cb-b6e0-4c19-8249-50150ca5aec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:02.822704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0b8cb-b6e0-4c19-8249-50150ca5aec7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:02.825574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 512/1036] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:02.825574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afad79a-63d6-4cd3-9be4-4e2f17915747 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:02.825774 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afad79a-63d6-4cd3-9be4-4e2f17915747 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:02.826015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afad79a-63d6-4cd3-9be4-4e2f17915747 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:02.827207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 513/1037] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:02.829772 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afad79a-63d6-4cd3-9be4-4e2f17915747 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:02.841553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629aa5cf-1a5a-47eb-bd0f-1b51ca5e9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:02.842181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa5cf-1a5a-47eb-bd0f-1b51ca5e9744 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:02.842454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa5cf-1a5a-47eb-bd0f-1b51ca5e9744 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:02.842724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629aa5cf-1a5a-47eb-bd0f-1b51ca5e9744 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:02.850622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629aa5cf-1a5a-47eb-bd0f-1b51ca5e9744 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:02.852056 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629aa5cf-1a5a-47eb-bd0f-1b51ca5e9744 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:02.855155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-629aa5cf-1a5a-47eb-bd0f-1b51ca5e9744 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:07:02.862690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:02.863819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:02.864836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:02.864836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:02.864836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:07:02.864836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:07:02.864836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:07:02.864836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:07:02.864836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:07:02.864836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:07:02.864836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:07:02.864836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:02.869398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 525/1038] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 17 16:07:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:07:02.870630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d81975-9c39-429e-b4fb-1b2bd9be394e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:02.870914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d81975-9c39-429e-b4fb-1b2bd9be394e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:02.871187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d81975-9c39-429e-b4fb-1b2bd9be394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:02.888736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-06d81975-9c39-429e-b4fb-1b2bd9be394e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:02.889934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-06d81975-9c39-429e-b4fb-1b2bd9be394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:02.934254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afad79a-63d6-4cd3-9be4-4e2f17915747 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:02.949468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:02.956769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 526/1039] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:02.957823 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d81975-9c39-429e-b4fb-1b2bd9be394e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:02.969002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1194ac-4f1e-43bb-9a52-20708fa7483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:02.969634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1194ac-4f1e-43bb-9a52-20708fa7483e None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:02.969906 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1194ac-4f1e-43bb-9a52-20708fa7483e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:02.970167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1194ac-4f1e-43bb-9a52-20708fa7483e None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:02.970794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1194ac-4f1e-43bb-9a52-20708fa7483e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:02.972469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1194ac-4f1e-43bb-9a52-20708fa7483e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:03.058524 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d81975-9c39-429e-b4fb-1b2bd9be394e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:03.096425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 514/1040] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:07:02 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:07:03.102952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ba073-d239-41f4-ac6b-4bb7144658c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:03.103694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba073-d239-41f4-ac6b-4bb7144658c7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:03.103902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba073-d239-41f4-ac6b-4bb7144658c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:03.104124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba073-d239-41f4-ac6b-4bb7144658c7 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:03.104882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ba073-d239-41f4-ac6b-4bb7144658c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:03.105185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ba073-d239-41f4-ac6b-4bb7144658c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:03.106773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ba073-d239-41f4-ac6b-4bb7144658c7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:03.138501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 527/1041] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 17 16:07:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:03.140192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1194ac-4f1e-43bb-9a52-20708fa7483e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:03.228930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ba073-d239-41f4-ac6b-4bb7144658c7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:03.232459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:03.252989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1194ac-4f1e-43bb-9a52-20708fa7483e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:03.293246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337865b-9612-4703-b6d1-defae8509f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:03.293888 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337865b-9612-4703-b6d1-defae8509f10 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:03.294161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337865b-9612-4703-b6d1-defae8509f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:03.294430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337865b-9612-4703-b6d1-defae8509f10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:03.294667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:03.346309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ba073-d239-41f4-ac6b-4bb7144658c7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:03.370288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337865b-9612-4703-b6d1-defae8509f10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:03.371858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337865b-9612-4703-b6d1-defae8509f10 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:03.381735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299104a4-ab49-4439-ac6d-c84f6e5a34cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:03.382729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299104a4-ab49-4439-ac6d-c84f6e5a34cb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:03.383006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299104a4-ab49-4439-ac6d-c84f6e5a34cb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:03.383274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299104a4-ab49-4439-ac6d-c84f6e5a34cb None admin] PATH_INFO: `/v3/services/image` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:03.384167 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299104a4-ab49-4439-ac6d-c84f6e5a34cb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:03.385719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299104a4-ab49-4439-ac6d-c84f6e5a34cb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-299104a4-ab49-4439-ac6d-c84f6e5a34cb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:03.395125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:03.396172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:03.397185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 528/1042] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 17 16:07:03 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:07:03.402070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299104a4-ab49-4439-ac6d-c84f6e5a34cb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:03.459847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:03.481120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 515/1043] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:03 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 16:07:03.487018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337865b-9612-4703-b6d1-defae8509f10 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:03.510704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299104a4-ab49-4439-ac6d-c84f6e5a34cb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:03.532878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:03.554156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d319aaf-6d4d-4cd4-b1fa-3661842a1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:03.555231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319aaf-6d4d-4cd4-b1fa-3661842a1658 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:03.555739 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319aaf-6d4d-4cd4-b1fa-3661842a1658 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:03.556108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319aaf-6d4d-4cd4-b1fa-3661842a1658 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:03.556742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d319aaf-6d4d-4cd4-b1fa-3661842a1658 None admin] RBAC: Adding query filter params (name=image) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:03.557042 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d319aaf-6d4d-4cd4-b1fa-3661842a1658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:03.558460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d319aaf-6d4d-4cd4-b1fa-3661842a1658 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:03.563430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 529/1044] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:03.569332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d319aaf-6d4d-4cd4-b1fa-3661842a1658 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:03.594426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337865b-9612-4703-b6d1-defae8509f10 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:03.631094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e87a26-dd21-4adc-88e7-d1e754cc76ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:03.631869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87a26-dd21-4adc-88e7-d1e754cc76ea None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:03.632144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87a26-dd21-4adc-88e7-d1e754cc76ea None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:03.632740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87a26-dd21-4adc-88e7-d1e754cc76ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:03.642976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e87a26-dd21-4adc-88e7-d1e754cc76ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:03.644408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e87a26-dd21-4adc-88e7-d1e754cc76ea None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-05e87a26-dd21-4adc-88e7-d1e754cc76ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:07:03.659846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:03.661023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:07:03.662589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:07:03.662589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:03.662589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:03.662589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 516/1045] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:07:03.667143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e87a26-dd21-4adc-88e7-d1e754cc76ea None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:03.679593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d319aaf-6d4d-4cd4-b1fa-3661842a1658 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:03.700070 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:03.714409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd06892-922d-4ef2-a6b3-d9917fcd81bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:03.715014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd06892-922d-4ef2-a6b3-d9917fcd81bf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:03.715287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd06892-922d-4ef2-a6b3-d9917fcd81bf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:03.715563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd06892-922d-4ef2-a6b3-d9917fcd81bf None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:03.716171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd06892-922d-4ef2-a6b3-d9917fcd81bf None admin] RBAC: Adding query filter params (type=image) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:03.716467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd06892-922d-4ef2-a6b3-d9917fcd81bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:03.717874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd06892-922d-4ef2-a6b3-d9917fcd81bf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:03.722559 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 530/1046] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:03.729632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd06892-922d-4ef2-a6b3-d9917fcd81bf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:03.776267 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:03.778748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e87a26-dd21-4adc-88e7-d1e754cc76ea None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:03.818296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4131f7-9a89-4b19-a85b-dce29da17666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:03.819090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4131f7-9a89-4b19-a85b-dce29da17666 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:03.819374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4131f7-9a89-4b19-a85b-dce29da17666 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:03.819648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4131f7-9a89-4b19-a85b-dce29da17666 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:03.820290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4131f7-9a89-4b19-a85b-dce29da17666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:03.820593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4131f7-9a89-4b19-a85b-dce29da17666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:03.822001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4131f7-9a89-4b19-a85b-dce29da17666 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:03.839326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 517/1047] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:03.840347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4131f7-9a89-4b19-a85b-dce29da17666 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:03.841818 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd06892-922d-4ef2-a6b3-d9917fcd81bf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:03.876981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5d00a-c5ce-4078-844c-f0db2ddfdbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:03.877608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d00a-c5ce-4078-844c-f0db2ddfdbd7 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:03.877885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d00a-c5ce-4078-844c-f0db2ddfdbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:03.878156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5d00a-c5ce-4078-844c-f0db2ddfdbd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:03.878801 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5d00a-c5ce-4078-844c-f0db2ddfdbd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:03.880149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5d00a-c5ce-4078-844c-f0db2ddfdbd7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:03.940783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:03.950416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4131f7-9a89-4b19-a85b-dce29da17666 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:03.969487 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 531/1048] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:07:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:07:04.000567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78711d90-4333-498b-8356-d36b2c161c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:04.001227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711d90-4333-498b-8356-d36b2c161c3a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:04.001542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711d90-4333-498b-8356-d36b2c161c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:04.001813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711d90-4333-498b-8356-d36b2c161c3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:04.010745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78711d90-4333-498b-8356-d36b2c161c3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:04.012277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78711d90-4333-498b-8356-d36b2c161c3a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-78711d90-4333-498b-8356-d36b2c161c3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:07:04.025631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:04.026677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:04.033170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:07:04.033170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:07:04.033170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:07:04.033170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:07:04.033170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:07:04.033170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:07:04.033170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:07:04.033170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:04.033170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 518/1049] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:07:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:04.033767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5d00a-c5ce-4078-844c-f0db2ddfdbd7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:04.147504 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5d00a-c5ce-4078-844c-f0db2ddfdbd7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:04.149083 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:04.183198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab85fb2-73e1-403a-a76a-70caa30a55a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:04.183815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85fb2-73e1-403a-a76a-70caa30a55a1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:04.184095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85fb2-73e1-403a-a76a-70caa30a55a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:04.184368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab85fb2-73e1-403a-a76a-70caa30a55a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:04.185060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab85fb2-73e1-403a-a76a-70caa30a55a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:04.185379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab85fb2-73e1-403a-a76a-70caa30a55a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:04.186882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab85fb2-73e1-403a-a76a-70caa30a55a1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:04.198999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 532/1050] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:07:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:04.205132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78711d90-4333-498b-8356-d36b2c161c3a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:04.309945 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78711d90-4333-498b-8356-d36b2c161c3a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:04.344278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57cd1c-e722-4250-80ad-90f32023d7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:04.344883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57cd1c-e722-4250-80ad-90f32023d7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:04.345158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57cd1c-e722-4250-80ad-90f32023d7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:04.345448 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57cd1c-e722-4250-80ad-90f32023d7f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:04.346229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57cd1c-e722-4250-80ad-90f32023d7f7 None admin] RBAC: Adding query filter params (role.id=2ab4ea75bfa748869c320610d3ca5088, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=f99edbaee8504487863c6fa4b551c224) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:04.346536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57cd1c-e722-4250-80ad-90f32023d7f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:04.347962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57cd1c-e722-4250-80ad-90f32023d7f7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:04.359976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 519/1051] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:07:04 2022] GET /identity/v3/role_assignments?user.id=f99edbaee8504487863c6fa4b551c224&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2ab4ea75bfa748869c320610d3ca5088 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:05.105428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8131a6-74da-407a-8fa0-5de29a771525 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:05.106005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8131a6-74da-407a-8fa0-5de29a771525 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:05.106005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8131a6-74da-407a-8fa0-5de29a771525 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:05.107351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 533/1052] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:05.112407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431fe6-1fbb-4cd0-856b-e8afda592c75 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:05.112828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431fe6-1fbb-4cd0-856b-e8afda592c75 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:05.112992 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431fe6-1fbb-4cd0-856b-e8afda592c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:05.133526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-39431fe6-1fbb-4cd0-856b-e8afda592c75 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:05.134716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-39431fe6-1fbb-4cd0-856b-e8afda592c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:05.142669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:05.204340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 520/1053] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:07:05.483282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8131a6-74da-407a-8fa0-5de29a771525 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:05.590141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8131a6-74da-407a-8fa0-5de29a771525 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:05.625200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c053200-2d78-4fc9-a04b-7d46fbc7726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:05.625864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c053200-2d78-4fc9-a04b-7d46fbc7726f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:05.626143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c053200-2d78-4fc9-a04b-7d46fbc7726f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:05.626413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c053200-2d78-4fc9-a04b-7d46fbc7726f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:05.637028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c053200-2d78-4fc9-a04b-7d46fbc7726f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8c053200-2d78-4fc9-a04b-7d46fbc7726f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:05.641871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:05.642798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:05.643725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 534/1054] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:07:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:05.650858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39431fe6-1fbb-4cd0-856b-e8afda592c75 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:05.755216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39431fe6-1fbb-4cd0-856b-e8afda592c75 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:05.795917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8e5f1-1530-4aee-b59f-8cdfd8e42220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:05.796530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8e5f1-1530-4aee-b59f-8cdfd8e42220 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:05.796808 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8e5f1-1530-4aee-b59f-8cdfd8e42220 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:05.797077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8e5f1-1530-4aee-b59f-8cdfd8e42220 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:05.797791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8e5f1-1530-4aee-b59f-8cdfd8e42220 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:05.798093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8e5f1-1530-4aee-b59f-8cdfd8e42220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:05.799461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8e5f1-1530-4aee-b59f-8cdfd8e42220 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:05.813934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 521/1055] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:07:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:05.815189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c053200-2d78-4fc9-a04b-7d46fbc7726f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:05.841467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:05.899369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686d81-52f4-48d4-be16-ef79a8b7d9c1 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:05.899695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686d81-52f4-48d4-be16-ef79a8b7d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:05.901405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686d81-52f4-48d4-be16-ef79a8b7d9c1 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:05.902506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 522/1056] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:05.906621 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ca25-4f0b-474d-9c99-e4569b8e5471 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:05.906905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ca25-4f0b-474d-9c99-e4569b8e5471 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:05.907178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ca25-4f0b-474d-9c99-e4569b8e5471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:05.914769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:05.925582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3c21ca25-4f0b-474d-9c99-e4569b8e5471 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:05.926754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3c21ca25-4f0b-474d-9c99-e4569b8e5471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:05.933429 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c053200-2d78-4fc9-a04b-7d46fbc7726f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:05.979441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535b2d1-1091-42a0-ada9-ddb302439d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:05.980330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b2d1-1091-42a0-ada9-ddb302439d12 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:05.980778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b2d1-1091-42a0-ada9-ddb302439d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:05.981213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b2d1-1091-42a0-ada9-ddb302439d12 None admin] PATH_INFO: `/v3/users/6f8ccc06eb4548e89c95f9a4e25188d7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:05.995760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535b2d1-1091-42a0-ada9-ddb302439d12 None admin] RBAC: Authorizing `identity:get_user(user_id=6f8ccc06eb4548e89c95f9a4e25188d7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:05.997623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535b2d1-1091-42a0-ada9-ddb302439d12 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:05.998239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 523/1057] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:07:06.003275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 535/1058] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:05 2022] GET /identity/v3/users/6f8ccc06eb4548e89c95f9a4e25188d7 => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:06.006018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21ca25-4f0b-474d-9c99-e4569b8e5471 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:06.108117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21ca25-4f0b-474d-9c99-e4569b8e5471 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:06.141495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b6b4-cf51-41a0-b253-8f549130c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:06.142112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b6b4-cf51-41a0-b253-8f549130c31f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:06.142353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b6b4-cf51-41a0-b253-8f549130c31f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:06.142614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b6b4-cf51-41a0-b253-8f549130c31f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:06.145188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:06.211972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7b6b4-cf51-41a0-b253-8f549130c31f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:06.213435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7b6b4-cf51-41a0-b253-8f549130c31f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:06.215988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb27c4-0a3c-4e2f-b6be-14f9f89fe53e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:06.216489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb27c4-0a3c-4e2f-b6be-14f9f89fe53e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:06.216584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb27c4-0a3c-4e2f-b6be-14f9f89fe53e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:06.217915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 536/1059] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:06.223561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d516320-e697-4145-999b-3ce1eab50f30 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:06.223849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d516320-e697-4145-999b-3ce1eab50f30 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:06.224314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d516320-e697-4145-999b-3ce1eab50f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:06.243068 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5d516320-e697-4145-999b-3ce1eab50f30 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:06.244266 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5d516320-e697-4145-999b-3ce1eab50f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:06.314231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 537/1060] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:07:06.314986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d516320-e697-4145-999b-3ce1eab50f30 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:06.318914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 524/1061] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 16:07:06.324569 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b6b4-cf51-41a0-b253-8f549130c31f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:06.327694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:06.358506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:06.419115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d516320-e697-4145-999b-3ce1eab50f30 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:06.441141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b6b4-cf51-41a0-b253-8f549130c31f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:06.454368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb81c5-4b40-43e0-90d1-565d518d9ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:06.454977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb81c5-4b40-43e0-90d1-565d518d9ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:06.455259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb81c5-4b40-43e0-90d1-565d518d9ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:06.455533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb81c5-4b40-43e0-90d1-565d518d9ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:06.478951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2586d-059d-46a7-bbf2-b44590b5de1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:06.479578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2586d-059d-46a7-bbf2-b44590b5de1a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:06.479847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2586d-059d-46a7-bbf2-b44590b5de1a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:06.480115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2586d-059d-46a7-bbf2-b44590b5de1a None admin] PATH_INFO: `/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:06.481303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2586d-059d-46a7-bbf2-b44590b5de1a None admin] RBAC: Authorizing `identity:get_project(project_id=05bd3bd2fd9d4ef5b2204012b4b51a1d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:06.482755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2586d-059d-46a7-bbf2-b44590b5de1a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:06.484558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 525/1062] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:06 2022] GET /identity/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:06.490910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2586d-059d-46a7-bbf2-b44590b5de1a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:06.527674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb81c5-4b40-43e0-90d1-565d518d9ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:06.529202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb81c5-4b40-43e0-90d1-565d518d9ba1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:06.541071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:06.596371 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2586d-059d-46a7-bbf2-b44590b5de1a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:06.597868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:06.631254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274a7d7-9616-42fe-bb25-a478125afcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:06.631858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a7d7-9616-42fe-bb25-a478125afcc8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:06.632131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a7d7-9616-42fe-bb25-a478125afcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:06.632398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a7d7-9616-42fe-bb25-a478125afcc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:06.632589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 538/1063] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:07:06.633113 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274a7d7-9616-42fe-bb25-a478125afcc8 None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=05bd3bd2fd9d4ef5b2204012b4b51a1d, user.id=6f8ccc06eb4548e89c95f9a4e25188d7) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:06.633521 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274a7d7-9616-42fe-bb25-a478125afcc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:06.633649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb81c5-4b40-43e0-90d1-565d518d9ba1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:06.634904 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274a7d7-9616-42fe-bb25-a478125afcc8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:06.648906 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 526/1064] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:07:06 2022] GET /identity/v3/role_assignments?user.id=6f8ccc06eb4548e89c95f9a4e25188d7&scope.project.id=05bd3bd2fd9d4ef5b2204012b4b51a1d&role.id=28beda93f70d4c549352145ddee01aac => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:06.648906 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274a7d7-9616-42fe-bb25-a478125afcc8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:06.751821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb81c5-4b40-43e0-90d1-565d518d9ba1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:06.757108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274a7d7-9616-42fe-bb25-a478125afcc8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:06.763542 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:06.789731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c917c-46de-475a-bafe-a8026f3e6035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:06.790375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c917c-46de-475a-bafe-a8026f3e6035 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:06.790836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c917c-46de-475a-bafe-a8026f3e6035 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:06.791186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c917c-46de-475a-bafe-a8026f3e6035 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:06.799895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c281fea-ff2f-4ac7-a99b-dbcb7305f590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:06.800735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c281fea-ff2f-4ac7-a99b-dbcb7305f590 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:06.801152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c281fea-ff2f-4ac7-a99b-dbcb7305f590 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:06.801599 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c281fea-ff2f-4ac7-a99b-dbcb7305f590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:06.802324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c917c-46de-475a-bafe-a8026f3e6035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5f8c917c-46de-475a-bafe-a8026f3e6035 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:06.806919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:06.808030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:06.809815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 539/1065] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 17 16:07:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:06.814907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c917c-46de-475a-bafe-a8026f3e6035 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:06.817922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c281fea-ff2f-4ac7-a99b-dbcb7305f590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:06.819387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c281fea-ff2f-4ac7-a99b-dbcb7305f590 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-4c281fea-ff2f-4ac7-a99b-dbcb7305f590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:07:06.835138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:06.836313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:07:06.837723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:07:06.837723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:06.837723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:06.837723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 527/1066] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:06.842032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c281fea-ff2f-4ac7-a99b-dbcb7305f590 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:06.862251 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:06.933903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c917c-46de-475a-bafe-a8026f3e6035 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:06.960092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c281fea-ff2f-4ac7-a99b-dbcb7305f590 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:06.973283 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e6ff5-f00a-4df8-bf1d-fb315655b8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:06.974553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6ff5-f00a-4df8-bf1d-fb315655b8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:06.974856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6ff5-f00a-4df8-bf1d-fb315655b8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:06.975159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6ff5-f00a-4df8-bf1d-fb315655b8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:06.975892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e6ff5-f00a-4df8-bf1d-fb315655b8a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:06.976195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e6ff5-f00a-4df8-bf1d-fb315655b8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:06.977692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e6ff5-f00a-4df8-bf1d-fb315655b8a8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:06.986063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 540/1067] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 17 16:07:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:06.991655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e6ff5-f00a-4df8-bf1d-fb315655b8a8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:07.011677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8dd3c-df55-4277-a060-35a3c6ab2111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:07.012289 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8dd3c-df55-4277-a060-35a3c6ab2111 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:07.012566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8dd3c-df55-4277-a060-35a3c6ab2111 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:07.012837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8dd3c-df55-4277-a060-35a3c6ab2111 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:07.013999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8dd3c-df55-4277-a060-35a3c6ab2111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:07.014311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8dd3c-df55-4277-a060-35a3c6ab2111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:07.016086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8dd3c-df55-4277-a060-35a3c6ab2111 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:07.024074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:07.031088 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 528/1068] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:07.104306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e6ff5-f00a-4df8-bf1d-fb315655b8a8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:07.143369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7026419-9319-4bbe-98fd-2f4bbe7262dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:07.143938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7026419-9319-4bbe-98fd-2f4bbe7262dc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:07.144213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7026419-9319-4bbe-98fd-2f4bbe7262dc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:07.144481 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7026419-9319-4bbe-98fd-2f4bbe7262dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:07.155868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7026419-9319-4bbe-98fd-2f4bbe7262dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:07.157332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7026419-9319-4bbe-98fd-2f4bbe7262dc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b7026419-9319-4bbe-98fd-2f4bbe7262dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:07:07.173556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:07.174572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:07:07.175665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:07:07.175665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:07.175665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:07.175665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 541/1069] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:07:07.180863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8dd3c-df55-4277-a060-35a3c6ab2111 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:07.267789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:07.291052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8dd3c-df55-4277-a060-35a3c6ab2111 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:07.328601 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf523dad-5a1a-4907-9230-ac628e6431ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:07.329240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf523dad-5a1a-4907-9230-ac628e6431ea None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:07.329585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf523dad-5a1a-4907-9230-ac628e6431ea None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:07.329854 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf523dad-5a1a-4907-9230-ac628e6431ea None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:07.330490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf523dad-5a1a-4907-9230-ac628e6431ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:07.330786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf523dad-5a1a-4907-9230-ac628e6431ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:07.332150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf523dad-5a1a-4907-9230-ac628e6431ea None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:07.343525 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 529/1070] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:07.350189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7026419-9319-4bbe-98fd-2f4bbe7262dc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:07.432139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:07.447481 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7026419-9319-4bbe-98fd-2f4bbe7262dc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:07.481192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ad860-a861-4c0c-8bd0-1ad3eab13e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:07.481852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ad860-a861-4c0c-8bd0-1ad3eab13e24 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:07.482127 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ad860-a861-4c0c-8bd0-1ad3eab13e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:07.482394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ad860-a861-4c0c-8bd0-1ad3eab13e24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:07.489209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ad860-a861-4c0c-8bd0-1ad3eab13e24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:07.490869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ad860-a861-4c0c-8bd0-1ad3eab13e24 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-360ad860-a861-4c0c-8bd0-1ad3eab13e24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:07:07.501900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:07.503026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:07.503986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:07.503986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:07.503986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:07:07.503986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:07:07.503986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:07:07.503986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:07:07.503986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:07:07.503986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:07:07.503986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:07:07.503986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:07.503986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 542/1071] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 17 16:07:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:07.508910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf523dad-5a1a-4907-9230-ac628e6431ea None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:07.608155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf523dad-5a1a-4907-9230-ac628e6431ea None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:07.641099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c07627-e933-422b-86a6-936355315c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:07.641732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c07627-e933-422b-86a6-936355315c92 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:07.642007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c07627-e933-422b-86a6-936355315c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:07.642271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c07627-e933-422b-86a6-936355315c92 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:07.642984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c07627-e933-422b-86a6-936355315c92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:07.643277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c07627-e933-422b-86a6-936355315c92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:07.644683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c07627-e933-422b-86a6-936355315c92 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:07.653410 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:07.662975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 530/1072] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 17 16:07:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:07.668655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ad860-a861-4c0c-8bd0-1ad3eab13e24 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:07.768558 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ad860-a861-4c0c-8bd0-1ad3eab13e24 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:07.801080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df42b57-0aaa-467d-897a-d868b0ece3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:07.801725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df42b57-0aaa-467d-897a-d868b0ece3bf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:07.802050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df42b57-0aaa-467d-897a-d868b0ece3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:07.802319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df42b57-0aaa-467d-897a-d868b0ece3bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:07.812408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df42b57-0aaa-467d-897a-d868b0ece3bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:07.813887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df42b57-0aaa-467d-897a-d868b0ece3bf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:07.816548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3df42b57-0aaa-467d-897a-d868b0ece3bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:07:07.828806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:07.829974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:07:07.831028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:07:07.831028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:07.831028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:07.831028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 543/1073] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:07:07.836531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c07627-e933-422b-86a6-936355315c92 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:07.939160 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c07627-e933-422b-86a6-936355315c92 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:07.972993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b98fed-6eb5-46e4-b4e6-c44976b3c938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:07.973619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98fed-6eb5-46e4-b4e6-c44976b3c938 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:07.973927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98fed-6eb5-46e4-b4e6-c44976b3c938 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:07.974192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98fed-6eb5-46e4-b4e6-c44976b3c938 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:07.979580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b98fed-6eb5-46e4-b4e6-c44976b3c938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:07.979580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b98fed-6eb5-46e4-b4e6-c44976b3c938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:07.979580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b98fed-6eb5-46e4-b4e6-c44976b3c938 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:07.987533 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 531/1074] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:07.993358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df42b57-0aaa-467d-897a-d868b0ece3bf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:08.092322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df42b57-0aaa-467d-897a-d868b0ece3bf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:08.124971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f34ea9-3fc2-408e-9653-247ea59ab2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:08.125626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34ea9-3fc2-408e-9653-247ea59ab2ce None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:08.125901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34ea9-3fc2-408e-9653-247ea59ab2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:08.126170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34ea9-3fc2-408e-9653-247ea59ab2ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:08.133245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f34ea9-3fc2-408e-9653-247ea59ab2ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:08.134723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f34ea9-3fc2-408e-9653-247ea59ab2ce None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-79f34ea9-3fc2-408e-9653-247ea59ab2ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:07:08.145523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:08.147183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:08.148214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:07:08.148214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:07:08.148214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:07:08.148214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:07:08.148214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:07:08.148214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:07:08.148214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:07:08.148214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:08.148214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 544/1075] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:07:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:08.153124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b98fed-6eb5-46e4-b4e6-c44976b3c938 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:08.208889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:08.252039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b98fed-6eb5-46e4-b4e6-c44976b3c938 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:08.286383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0388679-7747-4105-9bf9-5b5e9d491abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:08.286987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0388679-7747-4105-9bf9-5b5e9d491abc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:08.287262 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0388679-7747-4105-9bf9-5b5e9d491abc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:08.287530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0388679-7747-4105-9bf9-5b5e9d491abc None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:08.288211 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0388679-7747-4105-9bf9-5b5e9d491abc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:08.288511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0388679-7747-4105-9bf9-5b5e9d491abc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:08.289990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0388679-7747-4105-9bf9-5b5e9d491abc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:08.302464 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 532/1076] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:07:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:08.308380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f34ea9-3fc2-408e-9653-247ea59ab2ce None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:08.364053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:08.406551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f34ea9-3fc2-408e-9653-247ea59ab2ce None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:08.439231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776892f2-e223-4ac5-ab61-2c380c0b07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:08.439876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776892f2-e223-4ac5-ab61-2c380c0b07e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:08.440150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776892f2-e223-4ac5-ab61-2c380c0b07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:08.440422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776892f2-e223-4ac5-ab61-2c380c0b07e0 None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/f99edbaee8504487863c6fa4b551c224/roles/2ab4ea75bfa748869c320610d3ca5088` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:08.442866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776892f2-e223-4ac5-ab61-2c380c0b07e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=f99edbaee8504487863c6fa4b551c224, role_id=2ab4ea75bfa748869c320610d3ca5088)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:08.444294 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776892f2-e223-4ac5-ab61-2c380c0b07e0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:08.492826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 545/1077] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:07:08 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/f99edbaee8504487863c6fa4b551c224/roles/2ab4ea75bfa748869c320610d3ca5088 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:07:08.534974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c1b2-f9ad-413e-893d-2a24f3935a5f None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:08.535368 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c1b2-f9ad-413e-893d-2a24f3935a5f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:08.535735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c1b2-f9ad-413e-893d-2a24f3935a5f None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:08.538016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 533/1078] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:08.544205 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c7ab2-66b1-4489-b135-6ed25a13ae36 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:08.544488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c7ab2-66b1-4489-b135-6ed25a13ae36 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:08.544760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c7ab2-66b1-4489-b135-6ed25a13ae36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:08.563724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c24c7ab2-66b1-4489-b135-6ed25a13ae36 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:08.564977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c24c7ab2-66b1-4489-b135-6ed25a13ae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:08.638582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 546/1079] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:08.903511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8c1b2-f9ad-413e-893d-2a24f3935a5f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:09.004263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8c1b2-f9ad-413e-893d-2a24f3935a5f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:09.021936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:09.038606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611f01a-d440-417d-9f8e-2f8ce4a1694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:09.039227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f01a-d440-417d-9f8e-2f8ce4a1694e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:09.039493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f01a-d440-417d-9f8e-2f8ce4a1694e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:09.039755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f01a-d440-417d-9f8e-2f8ce4a1694e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:09.049758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611f01a-d440-417d-9f8e-2f8ce4a1694e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-e611f01a-d440-417d-9f8e-2f8ce4a1694e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:09.054967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:09.055897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:09.056748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 534/1080] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:07:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:09.061929 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c7ab2-66b1-4489-b135-6ed25a13ae36 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:09.107626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:09.162168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c7ab2-66b1-4489-b135-6ed25a13ae36 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:09.195112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cd24b-4038-4ecf-a8f3-d086e07a74f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:09.195705 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cd24b-4038-4ecf-a8f3-d086e07a74f7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:09.195977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cd24b-4038-4ecf-a8f3-d086e07a74f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:09.196248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cd24b-4038-4ecf-a8f3-d086e07a74f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:09.196899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cd24b-4038-4ecf-a8f3-d086e07a74f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:09.197194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cd24b-4038-4ecf-a8f3-d086e07a74f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:09.198657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cd24b-4038-4ecf-a8f3-d086e07a74f7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:09.207072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 547/1081] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:07:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:09.212723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611f01a-d440-417d-9f8e-2f8ce4a1694e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:09.308330 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611f01a-d440-417d-9f8e-2f8ce4a1694e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:09.340962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38c8c9-f4fd-44da-a2f6-747dabf94c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:09.341608 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c8c9-f4fd-44da-a2f6-747dabf94c53 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:09.341882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c8c9-f4fd-44da-a2f6-747dabf94c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:09.342147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c8c9-f4fd-44da-a2f6-747dabf94c53 None admin] PATH_INFO: `/v3/users/6f8ccc06eb4548e89c95f9a4e25188d7` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:09.343242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38c8c9-f4fd-44da-a2f6-747dabf94c53 None admin] RBAC: Authorizing `identity:get_user(user_id=6f8ccc06eb4548e89c95f9a4e25188d7)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:09.344659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38c8c9-f4fd-44da-a2f6-747dabf94c53 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:09.346408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 535/1082] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:09 2022] GET /identity/v3/users/6f8ccc06eb4548e89c95f9a4e25188d7 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:09.352781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cd24b-4038-4ecf-a8f3-d086e07a74f7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:09.449063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cd24b-4038-4ecf-a8f3-d086e07a74f7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:09.458974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:09.483137 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83854d-5108-4087-a60e-b9ae3144e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:09.483763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83854d-5108-4087-a60e-b9ae3144e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:09.484040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83854d-5108-4087-a60e-b9ae3144e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:09.484308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83854d-5108-4087-a60e-b9ae3144e2b6 None admin] PATH_INFO: `/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:09.485460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83854d-5108-4087-a60e-b9ae3144e2b6 None admin] RBAC: Authorizing `identity:get_project(project_id=05bd3bd2fd9d4ef5b2204012b4b51a1d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:09.486887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83854d-5108-4087-a60e-b9ae3144e2b6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:09.488516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 548/1083] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:09 2022] GET /identity/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:09.494606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38c8c9-f4fd-44da-a2f6-747dabf94c53 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:09.539691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:09.595703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38c8c9-f4fd-44da-a2f6-747dabf94c53 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:09.627965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d854d26-52cb-476c-b88d-6c2e89a393fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:09.628618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854d26-52cb-476c-b88d-6c2e89a393fa None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:09.628892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854d26-52cb-476c-b88d-6c2e89a393fa None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:09.629161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854d26-52cb-476c-b88d-6c2e89a393fa None admin] PATH_INFO: `/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d/users/6f8ccc06eb4548e89c95f9a4e25188d7/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:09.632239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d854d26-52cb-476c-b88d-6c2e89a393fa None admin] RBAC: Authorizing `identity:create_grant(project_id=05bd3bd2fd9d4ef5b2204012b4b51a1d, user_id=6f8ccc06eb4548e89c95f9a4e25188d7, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:09.633698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d854d26-52cb-476c-b88d-6c2e89a393fa None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:09.674711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 536/1084] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:07:09 2022] PUT /identity/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d/users/6f8ccc06eb4548e89c95f9a4e25188d7/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:07:10.387070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34596a5c-dd31-4174-86bd-e642767acea7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:10.387353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34596a5c-dd31-4174-86bd-e642767acea7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:10.387628 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34596a5c-dd31-4174-86bd-e642767acea7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:10.388977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 549/1085] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:10.394182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e703e9-2d32-4e3c-a144-b8f8eb3d3069 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:10.394627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e703e9-2d32-4e3c-a144-b8f8eb3d3069 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:10.394718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e703e9-2d32-4e3c-a144-b8f8eb3d3069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:10.412914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-11e703e9-2d32-4e3c-a144-b8f8eb3d3069 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:10.414117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-11e703e9-2d32-4e3c-a144-b8f8eb3d3069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:10.478940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 537/1086] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:10.743071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34596a5c-dd31-4174-86bd-e642767acea7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:10.843178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34596a5c-dd31-4174-86bd-e642767acea7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:10.878837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be471269-2a35-458d-a1c5-59e9a8595c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:10.879454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be471269-2a35-458d-a1c5-59e9a8595c00 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:10.879725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be471269-2a35-458d-a1c5-59e9a8595c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:10.880066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be471269-2a35-458d-a1c5-59e9a8595c00 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:10.889973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be471269-2a35-458d-a1c5-59e9a8595c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-be471269-2a35-458d-a1c5-59e9a8595c00 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:10.894547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:10.895639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:10.898235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 550/1087] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 17 16:07:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:10.901934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e703e9-2d32-4e3c-a144-b8f8eb3d3069 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:10.935537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:11.001937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e703e9-2d32-4e3c-a144-b8f8eb3d3069 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:11.035573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f0287-e0f4-428f-be97-e95f2892008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:11.036706 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f0287-e0f4-428f-be97-e95f2892008d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:11.036976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f0287-e0f4-428f-be97-e95f2892008d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:11.037262 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f0287-e0f4-428f-be97-e95f2892008d None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:11.037989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f0287-e0f4-428f-be97-e95f2892008d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:11.038327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f0287-e0f4-428f-be97-e95f2892008d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:11.039679 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f0287-e0f4-428f-be97-e95f2892008d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:11.047690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 538/1088] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 17 16:07:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:11.054584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be471269-2a35-458d-a1c5-59e9a8595c00 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:11.089168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:11.153533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be471269-2a35-458d-a1c5-59e9a8595c00 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:11.187862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cb230-ee7e-4687-9d91-4ed23c09bd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:11.188489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cb230-ee7e-4687-9d91-4ed23c09bd27 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:11.188764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cb230-ee7e-4687-9d91-4ed23c09bd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:11.189033 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cb230-ee7e-4687-9d91-4ed23c09bd27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:11.199829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20cb230-ee7e-4687-9d91-4ed23c09bd27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:11.201277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20cb230-ee7e-4687-9d91-4ed23c09bd27 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e20cb230-ee7e-4687-9d91-4ed23c09bd27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:07:11.216210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:11.217237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:07:11.218196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:07:11.218196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:11.218196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:11.221509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 551/1089] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:11.223256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f0287-e0f4-428f-be97-e95f2892008d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:11.316758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:11.322600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f0287-e0f4-428f-be97-e95f2892008d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:11.357106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29020b2c-89af-4a60-affa-66b265e54a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:11.357733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29020b2c-89af-4a60-affa-66b265e54a45 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:11.358004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29020b2c-89af-4a60-affa-66b265e54a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:11.358267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29020b2c-89af-4a60-affa-66b265e54a45 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:11.358896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29020b2c-89af-4a60-affa-66b265e54a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:11.359195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29020b2c-89af-4a60-affa-66b265e54a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:11.360550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29020b2c-89af-4a60-affa-66b265e54a45 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:11.371974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 539/1090] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:11.377649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cb230-ee7e-4687-9d91-4ed23c09bd27 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:11.463685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:11.475376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cb230-ee7e-4687-9d91-4ed23c09bd27 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:11.509935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504e52b-1b33-4a34-b7cf-0a0299c81735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:11.510559 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504e52b-1b33-4a34-b7cf-0a0299c81735 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:11.510834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504e52b-1b33-4a34-b7cf-0a0299c81735 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:11.511101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504e52b-1b33-4a34-b7cf-0a0299c81735 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:11.517952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504e52b-1b33-4a34-b7cf-0a0299c81735 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:11.519393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504e52b-1b33-4a34-b7cf-0a0299c81735 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9504e52b-1b33-4a34-b7cf-0a0299c81735 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:07:11.530673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:11.531632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:11.532581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:11.532581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:11.532581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:07:11.532581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:07:11.532581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:07:11.532581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:07:11.532581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:07:11.532581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:07:11.532581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:07:11.532581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:11.532581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 552/1091] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 17 16:07:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:11.538027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29020b2c-89af-4a60-affa-66b265e54a45 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:11.544575 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9888e-f2f9-4bb8-887c-af91d3131cec None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:11.544857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9888e-f2f9-4bb8-887c-af91d3131cec None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:11.545133 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9888e-f2f9-4bb8-887c-af91d3131cec None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:11.546605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 553/1092] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:07:11.551207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fd91c-9087-40ea-895b-4aa0ae477faa None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:11.551487 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fd91c-9087-40ea-895b-4aa0ae477faa None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:11.552402 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fd91c-9087-40ea-895b-4aa0ae477faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:11.571061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-243fd91c-9087-40ea-895b-4aa0ae477faa None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:11.572175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-243fd91c-9087-40ea-895b-4aa0ae477faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:11.637690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 554/1093] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:07:11.639407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29020b2c-89af-4a60-affa-66b265e54a45 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:11.673655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49331d0-2090-4cf9-b44c-304ccd4166d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:11.674256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49331d0-2090-4cf9-b44c-304ccd4166d1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:11.674531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49331d0-2090-4cf9-b44c-304ccd4166d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:11.674800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49331d0-2090-4cf9-b44c-304ccd4166d1 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:11.675516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49331d0-2090-4cf9-b44c-304ccd4166d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:11.675814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49331d0-2090-4cf9-b44c-304ccd4166d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:11.677885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49331d0-2090-4cf9-b44c-304ccd4166d1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:11.695369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 540/1094] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 17 16:07:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:11.701220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fd91c-9087-40ea-895b-4aa0ae477faa None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:11.776376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:11.797646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fd91c-9087-40ea-895b-4aa0ae477faa None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:11.833212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031427-c19b-460b-aa4d-cfa15dca73c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:11.833906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031427-c19b-460b-aa4d-cfa15dca73c3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:11.834185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031427-c19b-460b-aa4d-cfa15dca73c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:11.834458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031427-c19b-460b-aa4d-cfa15dca73c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:11.902387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11031427-c19b-460b-aa4d-cfa15dca73c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:11.903849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11031427-c19b-460b-aa4d-cfa15dca73c3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:11.906013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49331d0-2090-4cf9-b44c-304ccd4166d1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:11.921685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:11.983293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:12.004809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 555/1095] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:07:12.006942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49331d0-2090-4cf9-b44c-304ccd4166d1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:12.010515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031427-c19b-460b-aa4d-cfa15dca73c3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:12.041832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00071-56d1-4536-a76f-f630a6321878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:12.042468 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00071-56d1-4536-a76f-f630a6321878 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.042744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00071-56d1-4536-a76f-f630a6321878 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.043019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00071-56d1-4536-a76f-f630a6321878 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.052965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00071-56d1-4536-a76f-f630a6321878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-63c00071-56d1-4536-a76f-f630a6321878 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:12.057615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:12.058754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:12.059607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 541/1096] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:07:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:12.064573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00071-56d1-4536-a76f-f630a6321878 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:12.111706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031427-c19b-460b-aa4d-cfa15dca73c3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:12.138752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:12.146116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2d7b0-4b3e-4115-b6ce-5c8187daa856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:12.146883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d7b0-4b3e-4115-b6ce-5c8187daa856 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.147157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d7b0-4b3e-4115-b6ce-5c8187daa856 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.147423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2d7b0-4b3e-4115-b6ce-5c8187daa856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.157330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2d7b0-4b3e-4115-b6ce-5c8187daa856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:12.158824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2d7b0-4b3e-4115-b6ce-5c8187daa856 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:12.164713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00071-56d1-4536-a76f-f630a6321878 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-75d2d7b0-4b3e-4115-b6ce-5c8187daa856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:07:12.173238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:12.174330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:07:12.175279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:07:12.175279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:07:12.175279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:12.175279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 556/1097] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:07:12.180664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2d7b0-4b3e-4115-b6ce-5c8187daa856 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:12.205912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec3063-90c0-45a9-901d-fea845c11455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:12.206517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec3063-90c0-45a9-901d-fea845c11455 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.206790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec3063-90c0-45a9-901d-fea845c11455 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.207053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec3063-90c0-45a9-901d-fea845c11455 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.207703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec3063-90c0-45a9-901d-fea845c11455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:12.208222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec3063-90c0-45a9-901d-fea845c11455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:12.209781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec3063-90c0-45a9-901d-fea845c11455 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:12.211383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:12.218219 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 542/1098] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:07:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:12.224003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec3063-90c0-45a9-901d-fea845c11455 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:12.280197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2d7b0-4b3e-4115-b6ce-5c8187daa856 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:12.313028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba1db9-32e1-4ea9-83cd-18a455654fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:12.313648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba1db9-32e1-4ea9-83cd-18a455654fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.313921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba1db9-32e1-4ea9-83cd-18a455654fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.314188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba1db9-32e1-4ea9-83cd-18a455654fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.314816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba1db9-32e1-4ea9-83cd-18a455654fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:12.315107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba1db9-32e1-4ea9-83cd-18a455654fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:12.316728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba1db9-32e1-4ea9-83cd-18a455654fd9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:12.323763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec3063-90c0-45a9-901d-fea845c11455 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:12.328049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 557/1099] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:12.333783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba1db9-32e1-4ea9-83cd-18a455654fd9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:12.358138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171df582-0007-4410-a400-db7d72b35f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:12.358767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171df582-0007-4410-a400-db7d72b35f76 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.359044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171df582-0007-4410-a400-db7d72b35f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.359313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171df582-0007-4410-a400-db7d72b35f76 None admin] PATH_INFO: `/v3/users/6f8ccc06eb4548e89c95f9a4e25188d7` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.360439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171df582-0007-4410-a400-db7d72b35f76 None admin] RBAC: Authorizing `identity:get_user(user_id=6f8ccc06eb4548e89c95f9a4e25188d7)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:12.361961 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171df582-0007-4410-a400-db7d72b35f76 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:12.368987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 543/1100] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:12 2022] GET /identity/v3/users/6f8ccc06eb4548e89c95f9a4e25188d7 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:12.370159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171df582-0007-4410-a400-db7d72b35f76 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:12.373690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:12.422095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:12.432162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba1db9-32e1-4ea9-83cd-18a455654fd9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:12.466125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cc4c5-020e-4e90-bb82-293488f571d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:12.466752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cc4c5-020e-4e90-bb82-293488f571d3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.467030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cc4c5-020e-4e90-bb82-293488f571d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.467300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cc4c5-020e-4e90-bb82-293488f571d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.467807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171df582-0007-4410-a400-db7d72b35f76 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:12.474441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cc4c5-020e-4e90-bb82-293488f571d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:12.475964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cc4c5-020e-4e90-bb82-293488f571d3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-202cc4c5-020e-4e90-bb82-293488f571d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:07:12.487065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:12.488106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:12.489005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:07:12.489005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:07:12.489005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:07:12.489005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:07:12.489005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:07:12.489005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:07:12.489005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:07:12.489005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:12.489005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 558/1101] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:07:12.494505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cc4c5-020e-4e90-bb82-293488f571d3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:12.502358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06eeb5-d439-44e9-b0e3-9bf4ca529d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:12.502969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06eeb5-d439-44e9-b0e3-9bf4ca529d3a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.503242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06eeb5-d439-44e9-b0e3-9bf4ca529d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.503508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06eeb5-d439-44e9-b0e3-9bf4ca529d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.570589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06eeb5-d439-44e9-b0e3-9bf4ca529d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:12.572044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06eeb5-d439-44e9-b0e3-9bf4ca529d3a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:12.575094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:12.592156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cc4c5-020e-4e90-bb82-293488f571d3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:12.627186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4947f-b8de-4207-8c31-2021b95aab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:12.627716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4947f-b8de-4207-8c31-2021b95aab68 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.627986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4947f-b8de-4207-8c31-2021b95aab68 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.628256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4947f-b8de-4207-8c31-2021b95aab68 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.628934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4947f-b8de-4207-8c31-2021b95aab68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:12.629232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4947f-b8de-4207-8c31-2021b95aab68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:12.630957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4947f-b8de-4207-8c31-2021b95aab68 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:12.642493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 559/1102] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:12.648416 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4947f-b8de-4207-8c31-2021b95aab68 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:12.660671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:12.670103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 544/1103] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 16:07:12.675878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06eeb5-d439-44e9-b0e3-9bf4ca529d3a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:12.748452 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4947f-b8de-4207-8c31-2021b95aab68 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:12.775575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06eeb5-d439-44e9-b0e3-9bf4ca529d3a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:12.777896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:12.782559 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990bc1-48be-4bfb-a99c-59a539fc402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:12.783193 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990bc1-48be-4bfb-a99c-59a539fc402e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.783475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990bc1-48be-4bfb-a99c-59a539fc402e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.783745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990bc1-48be-4bfb-a99c-59a539fc402e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.784469 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1990bc1-48be-4bfb-a99c-59a539fc402e None admin] RBAC: Adding query filter params (role.id=2ab4ea75bfa748869c320610d3ca5088, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=f99edbaee8504487863c6fa4b551c224) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:12.784779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1990bc1-48be-4bfb-a99c-59a539fc402e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:12.787128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1990bc1-48be-4bfb-a99c-59a539fc402e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:12.793978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 560/1104] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:07:12 2022] GET /identity/v3/role_assignments?user.id=f99edbaee8504487863c6fa4b551c224&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2ab4ea75bfa748869c320610d3ca5088 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:12.810618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b9e41-f0e5-46c0-beb3-f921621ac93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:12.811278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9e41-f0e5-46c0-beb3-f921621ac93c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.811557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9e41-f0e5-46c0-beb3-f921621ac93c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.811830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b9e41-f0e5-46c0-beb3-f921621ac93c None admin] PATH_INFO: `/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.813130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b9e41-f0e5-46c0-beb3-f921621ac93c None admin] RBAC: Authorizing `identity:get_project(project_id=05bd3bd2fd9d4ef5b2204012b4b51a1d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:12.814645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b9e41-f0e5-46c0-beb3-f921621ac93c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:12.816656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 545/1105] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:12 2022] GET /identity/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:12.823443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990bc1-48be-4bfb-a99c-59a539fc402e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:12.905739 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:12.933089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990bc1-48be-4bfb-a99c-59a539fc402e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:12.968043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986798-ce6c-4c0b-8c83-c85d0ae5608e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:12.968642 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986798-ce6c-4c0b-8c83-c85d0ae5608e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.968914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986798-ce6c-4c0b-8c83-c85d0ae5608e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.969180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986798-ce6c-4c0b-8c83-c85d0ae5608e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.969956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4986798-ce6c-4c0b-8c83-c85d0ae5608e None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=05bd3bd2fd9d4ef5b2204012b4b51a1d, user.id=6f8ccc06eb4548e89c95f9a4e25188d7) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:12.970254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4986798-ce6c-4c0b-8c83-c85d0ae5608e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:12.971684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4986798-ce6c-4c0b-8c83-c85d0ae5608e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:12.978185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 561/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:07:12 2022] GET /identity/v3/role_assignments?user.id=6f8ccc06eb4548e89c95f9a4e25188d7&scope.project.id=05bd3bd2fd9d4ef5b2204012b4b51a1d&role.id=28beda93f70d4c549352145ddee01aac => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:14.907024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2e8fe-4f90-4058-a0b1-d45e2b58a7fb None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:14.907417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2e8fe-4f90-4058-a0b1-d45e2b58a7fb None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:14.907571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2e8fe-4f90-4058-a0b1-d45e2b58a7fb None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:14.908928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 546/1107] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:07:14.914308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b838a2c-b22e-4d6a-9e4d-edb9ac1cbeb6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:14.914687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b838a2c-b22e-4d6a-9e4d-edb9ac1cbeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:14.914843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b838a2c-b22e-4d6a-9e4d-edb9ac1cbeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:14.932310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6b838a2c-b22e-4d6a-9e4d-edb9ac1cbeb6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:14.933507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6b838a2c-b22e-4d6a-9e4d-edb9ac1cbeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:14.999017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 562/1108] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:15.268743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2e8fe-4f90-4058-a0b1-d45e2b58a7fb None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:15.368062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2e8fe-4f90-4058-a0b1-d45e2b58a7fb None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:15.400457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c75bb-afc0-44ea-ab22-700fb48a0819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:15.401067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c75bb-afc0-44ea-ab22-700fb48a0819 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:15.401341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c75bb-afc0-44ea-ab22-700fb48a0819 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:15.401643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c75bb-afc0-44ea-ab22-700fb48a0819 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:15.402734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c75bb-afc0-44ea-ab22-700fb48a0819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:15.404181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c75bb-afc0-44ea-ab22-700fb48a0819 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:15.405754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 547/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:15.411962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b838a2c-b22e-4d6a-9e4d-edb9ac1cbeb6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:15.475502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:15.507590 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b838a2c-b22e-4d6a-9e4d-edb9ac1cbeb6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:15.539639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da449726-85bb-4ebf-b610-cde58268ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:15.540175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449726-85bb-4ebf-b610-cde58268ee40 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:15.540454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449726-85bb-4ebf-b610-cde58268ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:15.540726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449726-85bb-4ebf-b610-cde58268ee40 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:15.541385 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da449726-85bb-4ebf-b610-cde58268ee40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:15.542810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da449726-85bb-4ebf-b610-cde58268ee40 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:15.646476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 563/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:07:15 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:07:17.559597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21372c-dd8a-434b-b2f9-9c662c7a04c9 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:17.560128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21372c-dd8a-434b-b2f9-9c662c7a04c9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:17.560128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21372c-dd8a-434b-b2f9-9c662c7a04c9 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:17.561492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 548/1111] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:17.567525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3466f1b-0b07-45f5-b4b7-121836fc743c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:17.567948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3466f1b-0b07-45f5-b4b7-121836fc743c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:17.568066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3466f1b-0b07-45f5-b4b7-121836fc743c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:17.586451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a3466f1b-0b07-45f5-b4b7-121836fc743c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:17.587615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a3466f1b-0b07-45f5-b4b7-121836fc743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:17.651052 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 564/1112] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:17.918837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21372c-dd8a-434b-b2f9-9c662c7a04c9 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:17.962610 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:18.020579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21372c-dd8a-434b-b2f9-9c662c7a04c9 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:18.054229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae23a2-cfaa-4b04-8366-f211948fc03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:18.054845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae23a2-cfaa-4b04-8366-f211948fc03b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:18.055118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae23a2-cfaa-4b04-8366-f211948fc03b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:18.055387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae23a2-cfaa-4b04-8366-f211948fc03b None admin] PATH_INFO: `/v3/roles/68da777efbc34e15a79e851577a8ee89` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:18.056863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae23a2-cfaa-4b04-8366-f211948fc03b None admin] RBAC: Authorizing `identity:get_role(role_id=68da777efbc34e15a79e851577a8ee89)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:18.058247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae23a2-cfaa-4b04-8366-f211948fc03b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:18.059563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 549/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:17 2022] GET /identity/v3/roles/68da777efbc34e15a79e851577a8ee89 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:18.065750 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3466f1b-0b07-45f5-b4b7-121836fc743c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:18.119228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:18.162834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3466f1b-0b07-45f5-b4b7-121836fc743c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:18.197041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f4b8b-1ee5-4745-a533-c19ed752eca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:18.197680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f4b8b-1ee5-4745-a533-c19ed752eca2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:18.197957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f4b8b-1ee5-4745-a533-c19ed752eca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:18.198225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f4b8b-1ee5-4745-a533-c19ed752eca2 None admin] PATH_INFO: `/v3/users/9f2fb29322fe45b6822b35e402d40738` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:18.210850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f4b8b-1ee5-4745-a533-c19ed752eca2 None admin] RBAC: Authorizing `identity:get_user(user_id=9f2fb29322fe45b6822b35e402d40738)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:18.212409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f4b8b-1ee5-4745-a533-c19ed752eca2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:18.214016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 565/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:18 2022] GET /identity/v3/users/9f2fb29322fe45b6822b35e402d40738 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:18.219792 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae23a2-cfaa-4b04-8366-f211948fc03b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:18.318137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae23a2-cfaa-4b04-8366-f211948fc03b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:18.327201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:18.351845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22223f-81be-4324-96b6-bb122303f7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:18.352440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22223f-81be-4324-96b6-bb122303f7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:18.352715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22223f-81be-4324-96b6-bb122303f7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:18.352984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22223f-81be-4324-96b6-bb122303f7c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:18.460943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22223f-81be-4324-96b6-bb122303f7c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:18.462337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22223f-81be-4324-96b6-bb122303f7c7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:18.557160 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 550/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:07:18.563076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f4b8b-1ee5-4745-a533-c19ed752eca2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:18.658184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f4b8b-1ee5-4745-a533-c19ed752eca2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:18.671331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:18.692194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac664104-78cc-450c-8cef-efcd627bb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:18.693069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac664104-78cc-450c-8cef-efcd627bb140 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:18.693635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac664104-78cc-450c-8cef-efcd627bb140 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:18.693911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac664104-78cc-450c-8cef-efcd627bb140 None admin] PATH_INFO: `/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:18.695016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac664104-78cc-450c-8cef-efcd627bb140 None admin] RBAC: Authorizing `identity:get_project(project_id=05bd3bd2fd9d4ef5b2204012b4b51a1d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:18.696441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac664104-78cc-450c-8cef-efcd627bb140 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:18.698070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 566/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:18 2022] GET /identity/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:18.704107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22223f-81be-4324-96b6-bb122303f7c7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:18.714604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:18.800682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22223f-81be-4324-96b6-bb122303f7c7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:18.833923 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634971f9-10ef-4fef-b156-f4841e8811e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:18.834514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634971f9-10ef-4fef-b156-f4841e8811e2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:18.834785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634971f9-10ef-4fef-b156-f4841e8811e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:18.835048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634971f9-10ef-4fef-b156-f4841e8811e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:18.835751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634971f9-10ef-4fef-b156-f4841e8811e2 None admin] RBAC: Adding query filter params (role.id=68da777efbc34e15a79e851577a8ee89, scope.project.id=05bd3bd2fd9d4ef5b2204012b4b51a1d, user.id=9f2fb29322fe45b6822b35e402d40738) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:18.836046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634971f9-10ef-4fef-b156-f4841e8811e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:18.837465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634971f9-10ef-4fef-b156-f4841e8811e2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:18.842633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 551/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:07:18 2022] GET /identity/v3/role_assignments?user.id=9f2fb29322fe45b6822b35e402d40738&scope.project.id=05bd3bd2fd9d4ef5b2204012b4b51a1d&role.id=68da777efbc34e15a79e851577a8ee89 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:20.695582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d48b-b3c0-48f6-9b99-eacfb92cbc7f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:20.696122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d48b-b3c0-48f6-9b99-eacfb92cbc7f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:20.696122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d48b-b3c0-48f6-9b99-eacfb92cbc7f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:20.697524 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 567/1118] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:20.702545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d2920-fd0c-48ad-8294-6485ad7046e7 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:20.702967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d2920-fd0c-48ad-8294-6485ad7046e7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:20.703060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d2920-fd0c-48ad-8294-6485ad7046e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:20.721241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ea5d2920-fd0c-48ad-8294-6485ad7046e7 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:20.722440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ea5d2920-fd0c-48ad-8294-6485ad7046e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:20.785952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 552/1119] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:21.053931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d48b-b3c0-48f6-9b99-eacfb92cbc7f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:21.152398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d48b-b3c0-48f6-9b99-eacfb92cbc7f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:21.184815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd674a-f382-4cd3-bbee-27dae9ef4ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:21.185461 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd674a-f382-4cd3-bbee-27dae9ef4ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:21.185737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd674a-f382-4cd3-bbee-27dae9ef4ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:21.186008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd674a-f382-4cd3-bbee-27dae9ef4ee0 None admin] PATH_INFO: `/v3/roles/68da777efbc34e15a79e851577a8ee89` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:21.187375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd674a-f382-4cd3-bbee-27dae9ef4ee0 None admin] RBAC: Authorizing `identity:get_role(role_id=68da777efbc34e15a79e851577a8ee89)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:21.188778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd674a-f382-4cd3-bbee-27dae9ef4ee0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:21.190105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 568/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:21 2022] GET /identity/v3/roles/68da777efbc34e15a79e851577a8ee89 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:21.196764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d2920-fd0c-48ad-8294-6485ad7046e7 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:21.199021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:21.294855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d2920-fd0c-48ad-8294-6485ad7046e7 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:21.328788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34306277-3300-45ac-9139-8903c75ef271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:21.329351 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34306277-3300-45ac-9139-8903c75ef271 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:21.329662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34306277-3300-45ac-9139-8903c75ef271 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:21.329932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34306277-3300-45ac-9139-8903c75ef271 None admin] PATH_INFO: `/v3/users/9f2fb29322fe45b6822b35e402d40738` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:21.331045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34306277-3300-45ac-9139-8903c75ef271 None admin] RBAC: Authorizing `identity:get_user(user_id=9f2fb29322fe45b6822b35e402d40738)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:21.332558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34306277-3300-45ac-9139-8903c75ef271 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:21.334294 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 553/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:21 2022] GET /identity/v3/users/9f2fb29322fe45b6822b35e402d40738 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:21.340080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd674a-f382-4cd3-bbee-27dae9ef4ee0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:21.388424 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:21.438018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd674a-f382-4cd3-bbee-27dae9ef4ee0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:21.470254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1b9b8-dc40-4cf2-9230-140d3c3ed943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:21.470862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b9b8-dc40-4cf2-9230-140d3c3ed943 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:21.471139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b9b8-dc40-4cf2-9230-140d3c3ed943 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:21.471411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b9b8-dc40-4cf2-9230-140d3c3ed943 None admin] PATH_INFO: `/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:21.472498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1b9b8-dc40-4cf2-9230-140d3c3ed943 None admin] RBAC: Authorizing `identity:get_project(project_id=05bd3bd2fd9d4ef5b2204012b4b51a1d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:21.474526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1b9b8-dc40-4cf2-9230-140d3c3ed943 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:21.476114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 569/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:21 2022] GET /identity/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:21.481963 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34306277-3300-45ac-9139-8903c75ef271 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:21.548697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:21.579141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34306277-3300-45ac-9139-8903c75ef271 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:21.612034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da04419-335a-4992-b405-269d2a40fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:21.612667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da04419-335a-4992-b405-269d2a40fbdd None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:21.612938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da04419-335a-4992-b405-269d2a40fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:21.613202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da04419-335a-4992-b405-269d2a40fbdd None admin] PATH_INFO: `/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d/users/9f2fb29322fe45b6822b35e402d40738/roles/68da777efbc34e15a79e851577a8ee89` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:21.616158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da04419-335a-4992-b405-269d2a40fbdd None admin] RBAC: Authorizing `identity:create_grant(project_id=05bd3bd2fd9d4ef5b2204012b4b51a1d, user_id=9f2fb29322fe45b6822b35e402d40738, role_id=68da777efbc34e15a79e851577a8ee89)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:21.617617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da04419-335a-4992-b405-269d2a40fbdd None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:21.685667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 554/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:07:21 2022] PUT /identity/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d/users/9f2fb29322fe45b6822b35e402d40738/roles/68da777efbc34e15a79e851577a8ee89 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:07:23.558452 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685af7-28f7-45a4-bcc9-2cb594d64ff9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:23.559071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685af7-28f7-45a4-bcc9-2cb594d64ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:23.559071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685af7-28f7-45a4-bcc9-2cb594d64ff9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:23.560330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 570/1124] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:23.566032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b31159-e78c-4739-bcf2-195f4ffdacbc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:23.566981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b31159-e78c-4739-bcf2-195f4ffdacbc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:23.567217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b31159-e78c-4739-bcf2-195f4ffdacbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:23.586816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c8b31159-e78c-4739-bcf2-195f4ffdacbc None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:23.588001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c8b31159-e78c-4739-bcf2-195f4ffdacbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:23.652554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 555/1125] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:23.920960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685af7-28f7-45a4-bcc9-2cb594d64ff9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:24.020430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685af7-28f7-45a4-bcc9-2cb594d64ff9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:24.036510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:24.053418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdcc76-88e2-4f51-9197-ddf6e736da67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:24.054041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdcc76-88e2-4f51-9197-ddf6e736da67 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:24.054319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdcc76-88e2-4f51-9197-ddf6e736da67 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:24.054591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdcc76-88e2-4f51-9197-ddf6e736da67 None admin] PATH_INFO: `/v3/roles/68da777efbc34e15a79e851577a8ee89` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:24.055955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdcc76-88e2-4f51-9197-ddf6e736da67 None admin] RBAC: Authorizing `identity:get_role(role_id=68da777efbc34e15a79e851577a8ee89)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:24.057501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdcc76-88e2-4f51-9197-ddf6e736da67 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:24.058790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 571/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:23 2022] GET /identity/v3/roles/68da777efbc34e15a79e851577a8ee89 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:24.064555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b31159-e78c-4739-bcf2-195f4ffdacbc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:24.122824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:24.162982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b31159-e78c-4739-bcf2-195f4ffdacbc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:24.195340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26a2a2-61a0-4350-803a-910fe48b0f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:24.195947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26a2a2-61a0-4350-803a-910fe48b0f8c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:24.196219 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26a2a2-61a0-4350-803a-910fe48b0f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:24.196481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26a2a2-61a0-4350-803a-910fe48b0f8c None admin] PATH_INFO: `/v3/users/9f2fb29322fe45b6822b35e402d40738` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:24.197600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26a2a2-61a0-4350-803a-910fe48b0f8c None admin] RBAC: Authorizing `identity:get_user(user_id=9f2fb29322fe45b6822b35e402d40738)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:24.199017 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26a2a2-61a0-4350-803a-910fe48b0f8c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:24.200551 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 556/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:24 2022] GET /identity/v3/users/9f2fb29322fe45b6822b35e402d40738 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:24.206260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdcc76-88e2-4f51-9197-ddf6e736da67 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:24.302640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdcc76-88e2-4f51-9197-ddf6e736da67 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:24.335424 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4620bf0-23df-4421-991d-c3edcbad95db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:24.336012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4620bf0-23df-4421-991d-c3edcbad95db None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:24.336287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4620bf0-23df-4421-991d-c3edcbad95db None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:24.336555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4620bf0-23df-4421-991d-c3edcbad95db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:24.385321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:24.400563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4620bf0-23df-4421-991d-c3edcbad95db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:24.402167 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4620bf0-23df-4421-991d-c3edcbad95db None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:24.496876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 572/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:07:24.502665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26a2a2-61a0-4350-803a-910fe48b0f8c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:24.600610 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26a2a2-61a0-4350-803a-910fe48b0f8c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:24.626042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:24.634147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263af8f-d941-44f8-97d0-dc5ae75ee686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:24.635213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263af8f-d941-44f8-97d0-dc5ae75ee686 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:24.635213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263af8f-d941-44f8-97d0-dc5ae75ee686 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:24.635397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263af8f-d941-44f8-97d0-dc5ae75ee686 None admin] PATH_INFO: `/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:24.636365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263af8f-d941-44f8-97d0-dc5ae75ee686 None admin] RBAC: Authorizing `identity:get_project(project_id=05bd3bd2fd9d4ef5b2204012b4b51a1d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:24.637821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263af8f-d941-44f8-97d0-dc5ae75ee686 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:24.639474 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 557/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:24 2022] GET /identity/v3/projects/05bd3bd2fd9d4ef5b2204012b4b51a1d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:24.646308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4620bf0-23df-4421-991d-c3edcbad95db None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:24.726880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:24.742133 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4620bf0-23df-4421-991d-c3edcbad95db None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:24.775802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27201910-c791-467f-b7eb-39f8a8cd1a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:24.776342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27201910-c791-467f-b7eb-39f8a8cd1a56 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:24.776622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27201910-c791-467f-b7eb-39f8a8cd1a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:24.776899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27201910-c791-467f-b7eb-39f8a8cd1a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:24.777641 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27201910-c791-467f-b7eb-39f8a8cd1a56 None admin] RBAC: Adding query filter params (role.id=68da777efbc34e15a79e851577a8ee89, scope.project.id=05bd3bd2fd9d4ef5b2204012b4b51a1d, user.id=9f2fb29322fe45b6822b35e402d40738) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:24.777955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27201910-c791-467f-b7eb-39f8a8cd1a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:24.779385 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27201910-c791-467f-b7eb-39f8a8cd1a56 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:24.784921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 573/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:07:24 2022] GET /identity/v3/role_assignments?user.id=9f2fb29322fe45b6822b35e402d40738&scope.project.id=05bd3bd2fd9d4ef5b2204012b4b51a1d&role.id=68da777efbc34e15a79e851577a8ee89 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:26.679320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378078-6ed4-4eaa-a167-4e613811a40a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:26.679861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378078-6ed4-4eaa-a167-4e613811a40a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:26.679861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378078-6ed4-4eaa-a167-4e613811a40a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:26.681225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 558/1131] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:26.686364 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b5af3-46a9-4802-b74d-6b22a7f14492 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:26.686755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b5af3-46a9-4802-b74d-6b22a7f14492 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:26.686909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b5af3-46a9-4802-b74d-6b22a7f14492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:26.705085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9c3b5af3-46a9-4802-b74d-6b22a7f14492 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:26.706285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9c3b5af3-46a9-4802-b74d-6b22a7f14492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:26.769103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 574/1132] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:27.042500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c378078-6ed4-4eaa-a167-4e613811a40a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:27.140636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c378078-6ed4-4eaa-a167-4e613811a40a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:27.174037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3c19f-fd15-44de-858f-a904c5b00bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:27.174648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3c19f-fd15-44de-858f-a904c5b00bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:27.174924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3c19f-fd15-44de-858f-a904c5b00bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:27.175193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3c19f-fd15-44de-858f-a904c5b00bc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:27.176341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3c19f-fd15-44de-858f-a904c5b00bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:27.177796 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3c19f-fd15-44de-858f-a904c5b00bc0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:27.179327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 559/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:27.185122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b5af3-46a9-4802-b74d-6b22a7f14492 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:27.259746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:27.280216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b5af3-46a9-4802-b74d-6b22a7f14492 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:27.314499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce11f2b-3e2d-42ac-a51d-95dda82bf641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:27.315281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11f2b-3e2d-42ac-a51d-95dda82bf641 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:27.315560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11f2b-3e2d-42ac-a51d-95dda82bf641 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:27.315829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11f2b-3e2d-42ac-a51d-95dda82bf641 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:27.316949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce11f2b-3e2d-42ac-a51d-95dda82bf641 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:27.318400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce11f2b-3e2d-42ac-a51d-95dda82bf641 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:27.389126 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 575/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:07:27 2022] POST /identity/v3/projects => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:07:29.294822 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73441bb-2bd0-4b36-8d11-d94e1945a74a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:29.295336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73441bb-2bd0-4b36-8d11-d94e1945a74a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:29.295336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73441bb-2bd0-4b36-8d11-d94e1945a74a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:29.296613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 560/1135] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:29.302497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c0879-d07d-4a8b-8f7d-6a7760f44a06 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:29.302894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c0879-d07d-4a8b-8f7d-6a7760f44a06 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:29.303052 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c0879-d07d-4a8b-8f7d-6a7760f44a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:29.322247 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-273c0879-d07d-4a8b-8f7d-6a7760f44a06 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:29.323428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-273c0879-d07d-4a8b-8f7d-6a7760f44a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:29.387765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 576/1136] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:07:29.656130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73441bb-2bd0-4b36-8d11-d94e1945a74a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:29.718162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:29.755168 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73441bb-2bd0-4b36-8d11-d94e1945a74a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:29.788796 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30058f8-4d59-4fd1-a4d5-400dff5d41bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:29.789438 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30058f8-4d59-4fd1-a4d5-400dff5d41bf None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:29.789715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30058f8-4d59-4fd1-a4d5-400dff5d41bf None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:29.789984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30058f8-4d59-4fd1-a4d5-400dff5d41bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:29.791077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30058f8-4d59-4fd1-a4d5-400dff5d41bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:29.792502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30058f8-4d59-4fd1-a4d5-400dff5d41bf None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:29.794084 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 561/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:07:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:29.799726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c0879-d07d-4a8b-8f7d-6a7760f44a06 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:29.857020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:29.897974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c0879-d07d-4a8b-8f7d-6a7760f44a06 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:29.932377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d383639-6b50-4c6c-b9a3-bb460b66bb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:29.932907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d383639-6b50-4c6c-b9a3-bb460b66bb1e None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:29.933180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d383639-6b50-4c6c-b9a3-bb460b66bb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:29.933479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d383639-6b50-4c6c-b9a3-bb460b66bb1e None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:29.934115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d383639-6b50-4c6c-b9a3-bb460b66bb1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:29.935535 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d383639-6b50-4c6c-b9a3-bb460b66bb1e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:30.041347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 577/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:07:29 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:07:32.089495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c1267-1e9b-4c21-a002-c8bd95f2b21b None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:32.090033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c1267-1e9b-4c21-a002-c8bd95f2b21b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:32.090033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c1267-1e9b-4c21-a002-c8bd95f2b21b None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:32.091363 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 562/1139] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:32.096425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736200b8-f1ea-40ea-a409-cde3a8f13b99 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:32.096815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736200b8-f1ea-40ea-a409-cde3a8f13b99 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:32.096969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736200b8-f1ea-40ea-a409-cde3a8f13b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:32.114649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-736200b8-f1ea-40ea-a409-cde3a8f13b99 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:32.115825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-736200b8-f1ea-40ea-a409-cde3a8f13b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:32.179510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 578/1140] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:32.448735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c1267-1e9b-4c21-a002-c8bd95f2b21b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:32.547193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c1267-1e9b-4c21-a002-c8bd95f2b21b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:32.576911 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:32.581705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df675fc6-446a-4487-b4b1-822061ff7084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:32.582352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675fc6-446a-4487-b4b1-822061ff7084 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:32.582629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675fc6-446a-4487-b4b1-822061ff7084 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:32.582899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675fc6-446a-4487-b4b1-822061ff7084 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:32.592656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df675fc6-446a-4487-b4b1-822061ff7084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-df675fc6-446a-4487-b4b1-822061ff7084 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:32.598059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:32.599369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:32.600562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 563/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:07:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:32.605169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736200b8-f1ea-40ea-a409-cde3a8f13b99 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:32.649327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:32.702256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736200b8-f1ea-40ea-a409-cde3a8f13b99 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:32.734905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd7c86-f527-4998-9597-ff263c0fb853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:32.735502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd7c86-f527-4998-9597-ff263c0fb853 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:32.735779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd7c86-f527-4998-9597-ff263c0fb853 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:32.736049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd7c86-f527-4998-9597-ff263c0fb853 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:32.736698 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd7c86-f527-4998-9597-ff263c0fb853 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:32.736996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd7c86-f527-4998-9597-ff263c0fb853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:32.739050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd7c86-f527-4998-9597-ff263c0fb853 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:32.747261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 579/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:07:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:32.753026 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df675fc6-446a-4487-b4b1-822061ff7084 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:32.850849 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df675fc6-446a-4487-b4b1-822061ff7084 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:32.884502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018886a6-00c6-4a29-b52a-52dacbb099c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:32.885122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018886a6-00c6-4a29-b52a-52dacbb099c0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:32.885421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018886a6-00c6-4a29-b52a-52dacbb099c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:32.885693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018886a6-00c6-4a29-b52a-52dacbb099c0 None admin] PATH_INFO: `/v3/users/6e39b488f14544868c550789313a7f4c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:32.899021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018886a6-00c6-4a29-b52a-52dacbb099c0 None admin] RBAC: Authorizing `identity:get_user(user_id=6e39b488f14544868c550789313a7f4c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:32.900450 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018886a6-00c6-4a29-b52a-52dacbb099c0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:32.902098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 564/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:32 2022] GET /identity/v3/users/6e39b488f14544868c550789313a7f4c => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:32.907922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd7c86-f527-4998-9597-ff263c0fb853 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:33.003853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd7c86-f527-4998-9597-ff263c0fb853 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:33.012638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:33.037664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aabd24-5593-4180-9d00-0935ee4524a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:33.038308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aabd24-5593-4180-9d00-0935ee4524a2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:33.038602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aabd24-5593-4180-9d00-0935ee4524a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:33.039097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aabd24-5593-4180-9d00-0935ee4524a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:33.103599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aabd24-5593-4180-9d00-0935ee4524a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:33.105032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aabd24-5593-4180-9d00-0935ee4524a2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:33.197324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 580/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:07:33.203179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018886a6-00c6-4a29-b52a-52dacbb099c0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:33.251574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:33.299408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018886a6-00c6-4a29-b52a-52dacbb099c0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:33.333246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6122b-44cf-4ef4-a9c3-fb0f9e321832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:33.333900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6122b-44cf-4ef4-a9c3-fb0f9e321832 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:33.334172 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6122b-44cf-4ef4-a9c3-fb0f9e321832 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:33.334434 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6122b-44cf-4ef4-a9c3-fb0f9e321832 None admin] PATH_INFO: `/v3/projects/a4490700a30a4b5ea0da5c9b2ce8e31e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:33.335526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6122b-44cf-4ef4-a9c3-fb0f9e321832 None admin] RBAC: Authorizing `identity:get_project(project_id=a4490700a30a4b5ea0da5c9b2ce8e31e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:33.336951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6122b-44cf-4ef4-a9c3-fb0f9e321832 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:33.338632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 565/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:33 2022] GET /identity/v3/projects/a4490700a30a4b5ea0da5c9b2ce8e31e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:33.344671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aabd24-5593-4180-9d00-0935ee4524a2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:33.355601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:33.442173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aabd24-5593-4180-9d00-0935ee4524a2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:33.475118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f71e2a-8bd6-4113-ac8d-1b8c82241a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:33.475711 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f71e2a-8bd6-4113-ac8d-1b8c82241a1d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:33.475984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f71e2a-8bd6-4113-ac8d-1b8c82241a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:33.476250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f71e2a-8bd6-4113-ac8d-1b8c82241a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:33.476959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f71e2a-8bd6-4113-ac8d-1b8c82241a1d None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=a4490700a30a4b5ea0da5c9b2ce8e31e, user.id=6e39b488f14544868c550789313a7f4c) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:33.477257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f71e2a-8bd6-4113-ac8d-1b8c82241a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:33.478728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f71e2a-8bd6-4113-ac8d-1b8c82241a1d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:33.483829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 581/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:07:33 2022] GET /identity/v3/role_assignments?user.id=6e39b488f14544868c550789313a7f4c&scope.project.id=a4490700a30a4b5ea0da5c9b2ce8e31e&role.id=28beda93f70d4c549352145ddee01aac => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:35.357556 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87437584-962f-45ef-b779-7580e4f5c652 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:35.358091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87437584-962f-45ef-b779-7580e4f5c652 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:35.358091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87437584-962f-45ef-b779-7580e4f5c652 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:35.359421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 566/1147] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:35.365106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae3cf3-79e4-4f0c-abf2-b6106f806039 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:35.365553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae3cf3-79e4-4f0c-abf2-b6106f806039 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:35.365663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae3cf3-79e4-4f0c-abf2-b6106f806039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:35.383200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2bae3cf3-79e4-4f0c-abf2-b6106f806039 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:35.384371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2bae3cf3-79e4-4f0c-abf2-b6106f806039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:35.448517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 582/1148] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:35.718947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87437584-962f-45ef-b779-7580e4f5c652 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:35.816661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87437584-962f-45ef-b779-7580e4f5c652 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:35.833823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:35.849697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42237ef5-9f90-4361-b766-1a6e8a5f7fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:35.850306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237ef5-9f90-4361-b766-1a6e8a5f7fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:35.850575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237ef5-9f90-4361-b766-1a6e8a5f7fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:35.850839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237ef5-9f90-4361-b766-1a6e8a5f7fe9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:35.860760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42237ef5-9f90-4361-b766-1a6e8a5f7fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-42237ef5-9f90-4361-b766-1a6e8a5f7fe9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:35.865498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:35.866666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:35.867509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 567/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:35.872833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae3cf3-79e4-4f0c-abf2-b6106f806039 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:35.875039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:35.970718 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae3cf3-79e4-4f0c-abf2-b6106f806039 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:36.004071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1d220-9217-4e27-a393-4207dfc8680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:36.004668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d220-9217-4e27-a393-4207dfc8680b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:36.004945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d220-9217-4e27-a393-4207dfc8680b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:36.005240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d220-9217-4e27-a393-4207dfc8680b None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:36.005921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1d220-9217-4e27-a393-4207dfc8680b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:36.006216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1d220-9217-4e27-a393-4207dfc8680b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:36.007584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1d220-9217-4e27-a393-4207dfc8680b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:36.015280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 583/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:07:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:36.021133 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42237ef5-9f90-4361-b766-1a6e8a5f7fe9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:36.118123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42237ef5-9f90-4361-b766-1a6e8a5f7fe9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:36.151031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402798d-b820-4efd-8aa8-51e9ed8d47e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:36.151642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402798d-b820-4efd-8aa8-51e9ed8d47e3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:36.151916 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402798d-b820-4efd-8aa8-51e9ed8d47e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:36.152182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402798d-b820-4efd-8aa8-51e9ed8d47e3 None admin] PATH_INFO: `/v3/users/6e39b488f14544868c550789313a7f4c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:36.153283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402798d-b820-4efd-8aa8-51e9ed8d47e3 None admin] RBAC: Authorizing `identity:get_user(user_id=6e39b488f14544868c550789313a7f4c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:36.154740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402798d-b820-4efd-8aa8-51e9ed8d47e3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:36.156295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 568/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:36 2022] GET /identity/v3/users/6e39b488f14544868c550789313a7f4c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:36.162217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1d220-9217-4e27-a393-4207dfc8680b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:36.222589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:36.259707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1d220-9217-4e27-a393-4207dfc8680b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:36.291364 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78b688-ac03-4b8f-bcad-3ca5017cc7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:36.291974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78b688-ac03-4b8f-bcad-3ca5017cc7dd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:36.292250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78b688-ac03-4b8f-bcad-3ca5017cc7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:36.292520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78b688-ac03-4b8f-bcad-3ca5017cc7dd None admin] PATH_INFO: `/v3/projects/a4490700a30a4b5ea0da5c9b2ce8e31e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:36.293633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78b688-ac03-4b8f-bcad-3ca5017cc7dd None admin] RBAC: Authorizing `identity:get_project(project_id=a4490700a30a4b5ea0da5c9b2ce8e31e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:36.295064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78b688-ac03-4b8f-bcad-3ca5017cc7dd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:36.296644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 584/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:36 2022] GET /identity/v3/projects/a4490700a30a4b5ea0da5c9b2ce8e31e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:36.303143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402798d-b820-4efd-8aa8-51e9ed8d47e3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:36.349759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:36.401134 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402798d-b820-4efd-8aa8-51e9ed8d47e3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:36.434456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00e282-bb1d-423f-8be1-c5ab40986ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:36.435098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00e282-bb1d-423f-8be1-c5ab40986ada None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:36.435374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00e282-bb1d-423f-8be1-c5ab40986ada None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:36.435644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00e282-bb1d-423f-8be1-c5ab40986ada None admin] PATH_INFO: `/v3/projects/a4490700a30a4b5ea0da5c9b2ce8e31e/users/6e39b488f14544868c550789313a7f4c/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:36.437538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00e282-bb1d-423f-8be1-c5ab40986ada None admin] RBAC: Authorizing `identity:create_grant(project_id=a4490700a30a4b5ea0da5c9b2ce8e31e, user_id=6e39b488f14544868c550789313a7f4c, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:36.438955 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00e282-bb1d-423f-8be1-c5ab40986ada None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:36.495974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 569/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:07:36 2022] PUT /identity/v3/projects/a4490700a30a4b5ea0da5c9b2ce8e31e/users/6e39b488f14544868c550789313a7f4c/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:07:38.346852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6b2fb-9681-4402-b487-0dcad710aa9c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:38.347439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6b2fb-9681-4402-b487-0dcad710aa9c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:38.347439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6b2fb-9681-4402-b487-0dcad710aa9c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:38.348713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 585/1154] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:38.354531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782432-8475-4ffe-94e4-cbe5c23e1f41 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:38.354964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782432-8475-4ffe-94e4-cbe5c23e1f41 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:38.355064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782432-8475-4ffe-94e4-cbe5c23e1f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:38.372736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4f782432-8475-4ffe-94e4-cbe5c23e1f41 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:38.373954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4f782432-8475-4ffe-94e4-cbe5c23e1f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:38.440020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 570/1155] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:38.710108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6b2fb-9681-4402-b487-0dcad710aa9c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:38.809553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6b2fb-9681-4402-b487-0dcad710aa9c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:38.837411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:38.842076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793d15-968e-4766-b94c-2f89e1614e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:38.842690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793d15-968e-4766-b94c-2f89e1614e7e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:38.842966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793d15-968e-4766-b94c-2f89e1614e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:38.843233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793d15-968e-4766-b94c-2f89e1614e7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:38.853575 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74793d15-968e-4766-b94c-2f89e1614e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-74793d15-968e-4766-b94c-2f89e1614e7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:38.858189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:38.859298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:38.860368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 586/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:07:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:38.866209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f782432-8475-4ffe-94e4-cbe5c23e1f41 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:38.899901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:38.963860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f782432-8475-4ffe-94e4-cbe5c23e1f41 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:38.997025 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313d7bc-5958-4274-bb48-b9407bd6e0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:38.997661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d7bc-5958-4274-bb48-b9407bd6e0ab None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:38.997931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d7bc-5958-4274-bb48-b9407bd6e0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:38.998198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d7bc-5958-4274-bb48-b9407bd6e0ab None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:38.998854 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313d7bc-5958-4274-bb48-b9407bd6e0ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:38.999151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313d7bc-5958-4274-bb48-b9407bd6e0ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:39.000508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313d7bc-5958-4274-bb48-b9407bd6e0ab None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:39.008516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 571/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:07:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:39.014304 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793d15-968e-4766-b94c-2f89e1614e7e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:39.113601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793d15-968e-4766-b94c-2f89e1614e7e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:39.146184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce859e2-f005-4904-8f34-bc72fb25f7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:39.146803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce859e2-f005-4904-8f34-bc72fb25f7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:39.147080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce859e2-f005-4904-8f34-bc72fb25f7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:39.147350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce859e2-f005-4904-8f34-bc72fb25f7d8 None admin] PATH_INFO: `/v3/users/6e39b488f14544868c550789313a7f4c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:39.148458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce859e2-f005-4904-8f34-bc72fb25f7d8 None admin] RBAC: Authorizing `identity:get_user(user_id=6e39b488f14544868c550789313a7f4c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:39.149924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce859e2-f005-4904-8f34-bc72fb25f7d8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:39.151482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 587/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:39 2022] GET /identity/v3/users/6e39b488f14544868c550789313a7f4c => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:39.157379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313d7bc-5958-4274-bb48-b9407bd6e0ab None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:39.251477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:39.255291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313d7bc-5958-4274-bb48-b9407bd6e0ab None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:39.288604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254b861-5a27-40df-af04-c459052a6e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:39.289191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254b861-5a27-40df-af04-c459052a6e8a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:39.289489 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254b861-5a27-40df-af04-c459052a6e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:39.289755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254b861-5a27-40df-af04-c459052a6e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:39.354212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254b861-5a27-40df-af04-c459052a6e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:39.355639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254b861-5a27-40df-af04-c459052a6e8a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:39.446969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:39.451098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 572/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:07:39.457671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce859e2-f005-4904-8f34-bc72fb25f7d8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:39.514067 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:39.553189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce859e2-f005-4904-8f34-bc72fb25f7d8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:39.585866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd15a6-31db-49eb-987c-b6604b31be28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:39.586479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd15a6-31db-49eb-987c-b6604b31be28 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:39.586752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd15a6-31db-49eb-987c-b6604b31be28 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:39.587018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd15a6-31db-49eb-987c-b6604b31be28 None admin] PATH_INFO: `/v3/projects/a4490700a30a4b5ea0da5c9b2ce8e31e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:39.588097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd15a6-31db-49eb-987c-b6604b31be28 None admin] RBAC: Authorizing `identity:get_project(project_id=a4490700a30a4b5ea0da5c9b2ce8e31e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:39.589549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd15a6-31db-49eb-987c-b6604b31be28 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:39.591125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 588/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:39 2022] GET /identity/v3/projects/a4490700a30a4b5ea0da5c9b2ce8e31e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:39.597264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254b861-5a27-40df-af04-c459052a6e8a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:39.693243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254b861-5a27-40df-af04-c459052a6e8a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:39.726376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674379b-3ab8-4816-ac97-3d540faf943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:39.726961 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674379b-3ab8-4816-ac97-3d540faf943c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:39.727236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674379b-3ab8-4816-ac97-3d540faf943c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:39.727498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674379b-3ab8-4816-ac97-3d540faf943c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:39.728203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674379b-3ab8-4816-ac97-3d540faf943c None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=a4490700a30a4b5ea0da5c9b2ce8e31e, user.id=6e39b488f14544868c550789313a7f4c) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:39.728500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674379b-3ab8-4816-ac97-3d540faf943c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:39.729946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674379b-3ab8-4816-ac97-3d540faf943c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:39.735526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 573/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:07:39 2022] GET /identity/v3/role_assignments?user.id=6e39b488f14544868c550789313a7f4c&scope.project.id=a4490700a30a4b5ea0da5c9b2ce8e31e&role.id=28beda93f70d4c549352145ddee01aac => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:41.627992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef4a6-3764-4bea-a876-6e049b43b2a4 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:41.628553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef4a6-3764-4bea-a876-6e049b43b2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:41.628553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef4a6-3764-4bea-a876-6e049b43b2a4 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:41.629907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 589/1162] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:41.635093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eebe8f-7317-46ed-bd90-ba4c3cb439ec None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:41.635462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eebe8f-7317-46ed-bd90-ba4c3cb439ec None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:41.635637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eebe8f-7317-46ed-bd90-ba4c3cb439ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:41.653093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-45eebe8f-7317-46ed-bd90-ba4c3cb439ec None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:41.654291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-45eebe8f-7317-46ed-bd90-ba4c3cb439ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:41.709429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:41.718923 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 574/1163] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:41.983176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ef4a6-3764-4bea-a876-6e049b43b2a4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:42.082007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ef4a6-3764-4bea-a876-6e049b43b2a4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:42.107384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:42.114755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9d472-836c-4d99-b6bf-1ad0f64e35a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:42.115354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9d472-836c-4d99-b6bf-1ad0f64e35a1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:42.120058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9d472-836c-4d99-b6bf-1ad0f64e35a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:42.120058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9d472-836c-4d99-b6bf-1ad0f64e35a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:42.180768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9d472-836c-4d99-b6bf-1ad0f64e35a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:42.182177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9d472-836c-4d99-b6bf-1ad0f64e35a1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:42.276326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 590/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:07:42.282170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eebe8f-7317-46ed-bd90-ba4c3cb439ec None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:42.377291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eebe8f-7317-46ed-bd90-ba4c3cb439ec None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:42.410718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d02e9-d74a-4a7e-90fc-19bf37de0653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:42.411323 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d02e9-d74a-4a7e-90fc-19bf37de0653 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:42.411594 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d02e9-d74a-4a7e-90fc-19bf37de0653 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:42.411856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d02e9-d74a-4a7e-90fc-19bf37de0653 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:42.418285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d02e9-d74a-4a7e-90fc-19bf37de0653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:42.419703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d02e9-d74a-4a7e-90fc-19bf37de0653 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-523d02e9-d74a-4a7e-90fc-19bf37de0653 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:42.431202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:42.432226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:42.433180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 575/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 17 16:07:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:42.438029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9d472-836c-4d99-b6bf-1ad0f64e35a1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:42.464704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:42.533306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9d472-836c-4d99-b6bf-1ad0f64e35a1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:42.567528 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1091e4-ac17-40e5-8d94-02d9316dd0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:42.568118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1091e4-ac17-40e5-8d94-02d9316dd0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:42.568395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1091e4-ac17-40e5-8d94-02d9316dd0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:42.568666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1091e4-ac17-40e5-8d94-02d9316dd0c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:42.569297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1091e4-ac17-40e5-8d94-02d9316dd0c8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:42.569623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1091e4-ac17-40e5-8d94-02d9316dd0c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:42.570980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1091e4-ac17-40e5-8d94-02d9316dd0c8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:42.577829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 591/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 17 16:07:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:44.432940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ba079-b8b4-49f8-aa7f-4a03a5a411d4 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:44.433533 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ba079-b8b4-49f8-aa7f-4a03a5a411d4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:44.433533 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ba079-b8b4-49f8-aa7f-4a03a5a411d4 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:44.434860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 576/1167] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:44.440373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a247d-36b9-4593-bdc0-8e9a702d94eb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:44.440812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a247d-36b9-4593-bdc0-8e9a702d94eb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:44.440907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a247d-36b9-4593-bdc0-8e9a702d94eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:44.458835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ae4a247d-36b9-4593-bdc0-8e9a702d94eb None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:44.459992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ae4a247d-36b9-4593-bdc0-8e9a702d94eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:44.523914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 592/1168] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:44.792478 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ba079-b8b4-49f8-aa7f-4a03a5a411d4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:44.844888 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:44.892937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ba079-b8b4-49f8-aa7f-4a03a5a411d4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:44.927220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3fd58-7438-41f0-95ee-6a72583c4847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:44.927815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3fd58-7438-41f0-95ee-6a72583c4847 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:44.928090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3fd58-7438-41f0-95ee-6a72583c4847 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:44.928360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3fd58-7438-41f0-95ee-6a72583c4847 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:44.929023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3fd58-7438-41f0-95ee-6a72583c4847 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:44.930408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3fd58-7438-41f0-95ee-6a72583c4847 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:44.999895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 577/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Wed Aug 17 16:07:44 2022] POST /identity/v3/domains => generated 267 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:07:46.941417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca427f-728d-460d-9178-3c47ded43a5d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:46.941864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca427f-728d-460d-9178-3c47ded43a5d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:46.941977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca427f-728d-460d-9178-3c47ded43a5d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:46.943323 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 593/1170] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:46.948539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b693bf-2286-4251-aca6-7543db89cd7a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:46.948969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b693bf-2286-4251-aca6-7543db89cd7a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:46.949091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b693bf-2286-4251-aca6-7543db89cd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:46.969928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-87b693bf-2286-4251-aca6-7543db89cd7a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:46.971277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-87b693bf-2286-4251-aca6-7543db89cd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:47.037071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 578/1171] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:47.315710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca427f-728d-460d-9178-3c47ded43a5d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:47.339391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:47.419777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca427f-728d-460d-9178-3c47ded43a5d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:47.453334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a541f0-187d-48ce-957b-6411562cd79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:47.453975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a541f0-187d-48ce-957b-6411562cd79b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:47.454251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a541f0-187d-48ce-957b-6411562cd79b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:47.454520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a541f0-187d-48ce-957b-6411562cd79b None admin] PATH_INFO: `/v3/domains/1dd4b6cb3c3b46bf95538fcf22b1fcc1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:47.464633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a541f0-187d-48ce-957b-6411562cd79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=1dd4b6cb3c3b46bf95538fcf22b1fcc1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:47.466101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a541f0-187d-48ce-957b-6411562cd79b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:47.467661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 594/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Aug 17 16:07:47 2022] GET /identity/v3/domains/1dd4b6cb3c3b46bf95538fcf22b1fcc1 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:47.473641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b693bf-2286-4251-aca6-7543db89cd7a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:47.516033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:47.571922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b693bf-2286-4251-aca6-7543db89cd7a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:47.605272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a29ffa-4f5b-4687-9d25-ca6166822fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:47.605900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a29ffa-4f5b-4687-9d25-ca6166822fb0 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:47.606175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a29ffa-4f5b-4687-9d25-ca6166822fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:47.606445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a29ffa-4f5b-4687-9d25-ca6166822fb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:47.607074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a29ffa-4f5b-4687-9d25-ca6166822fb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:47.608496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a29ffa-4f5b-4687-9d25-ca6166822fb0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:47.684597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 579/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:07:47 2022] POST /identity/v3/projects => generated 361 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:07:49.578466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5c4f3-88c8-44f0-96b9-440fd8231024 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:49.579038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5c4f3-88c8-44f0-96b9-440fd8231024 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:49.579038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5c4f3-88c8-44f0-96b9-440fd8231024 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:49.580960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 595/1174] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:49.586198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43583-b787-48f1-b721-16d590702880 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:49.586616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43583-b787-48f1-b721-16d590702880 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:49.586774 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43583-b787-48f1-b721-16d590702880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:49.604979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7bd43583-b787-48f1-b721-16d590702880 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:49.606182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7bd43583-b787-48f1-b721-16d590702880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:49.670432 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 580/1175] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:49.937558 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5c4f3-88c8-44f0-96b9-440fd8231024 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:50.024289 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:50.042967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5c4f3-88c8-44f0-96b9-440fd8231024 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:50.077869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1be54-a61f-49ab-9b01-657281d9f060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:50.078498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1be54-a61f-49ab-9b01-657281d9f060 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:50.078776 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1be54-a61f-49ab-9b01-657281d9f060 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:50.079045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1be54-a61f-49ab-9b01-657281d9f060 None admin] PATH_INFO: `/v3/domains/1dd4b6cb3c3b46bf95538fcf22b1fcc1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:50.080208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1be54-a61f-49ab-9b01-657281d9f060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1dd4b6cb3c3b46bf95538fcf22b1fcc1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:50.082327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1be54-a61f-49ab-9b01-657281d9f060 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:50.083887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 596/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Aug 17 16:07:49 2022] GET /identity/v3/domains/1dd4b6cb3c3b46bf95538fcf22b1fcc1 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:50.089701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43583-b787-48f1-b721-16d590702880 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:50.114575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:50.192228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43583-b787-48f1-b721-16d590702880 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:50.224829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7487e48-2893-4499-affe-9f801495c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:50.225452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7487e48-2893-4499-affe-9f801495c5ed None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:50.225730 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7487e48-2893-4499-affe-9f801495c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:50.225997 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7487e48-2893-4499-affe-9f801495c5ed None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:50.226628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7487e48-2893-4499-affe-9f801495c5ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:50.228050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7487e48-2893-4499-affe-9f801495c5ed None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:50.295178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 581/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:07:50 2022] POST /identity/v3/users => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:07:52.237646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26eeeb6-7d58-4cf8-bca9-5e6bb4f91a99 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:52.238171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26eeeb6-7d58-4cf8-bca9-5e6bb4f91a99 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:52.238171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26eeeb6-7d58-4cf8-bca9-5e6bb4f91a99 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:52.239437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 597/1178] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:52.244554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1eda-05c8-4b3c-8e55-c23966964367 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:52.244974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1eda-05c8-4b3c-8e55-c23966964367 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:52.245095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb1eda-05c8-4b3c-8e55-c23966964367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:52.262734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-edbb1eda-05c8-4b3c-8e55-c23966964367 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:52.263900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-edbb1eda-05c8-4b3c-8e55-c23966964367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:52.328561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 582/1179] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:52.598259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26eeeb6-7d58-4cf8-bca9-5e6bb4f91a99 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:52.696886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26eeeb6-7d58-4cf8-bca9-5e6bb4f91a99 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:52.729272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fef983-4b8e-4738-846a-6d68b1d93065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:52.729905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fef983-4b8e-4738-846a-6d68b1d93065 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:52.730183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fef983-4b8e-4738-846a-6d68b1d93065 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:52.730454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fef983-4b8e-4738-846a-6d68b1d93065 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:52.740677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fef983-4b8e-4738-846a-6d68b1d93065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a4fef983-4b8e-4738-846a-6d68b1d93065 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:52.745271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:52.746355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:52.747516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 598/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:07:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:52.752950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb1eda-05c8-4b3c-8e55-c23966964367 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:52.764236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:52.848100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb1eda-05c8-4b3c-8e55-c23966964367 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:52.880664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097b364-e3c0-49bb-8e0f-e9502b214ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:52.881300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097b364-e3c0-49bb-8e0f-e9502b214ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:52.881609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097b364-e3c0-49bb-8e0f-e9502b214ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:52.881878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097b364-e3c0-49bb-8e0f-e9502b214ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:52.882545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097b364-e3c0-49bb-8e0f-e9502b214ed8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:52.882843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097b364-e3c0-49bb-8e0f-e9502b214ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:52.884212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097b364-e3c0-49bb-8e0f-e9502b214ed8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:52.892431 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 583/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:07:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:52.898463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fef983-4b8e-4738-846a-6d68b1d93065 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:52.913615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:52.998513 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fef983-4b8e-4738-846a-6d68b1d93065 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:53.031265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d76ebd-ff2f-4f9b-8717-297bf49e1892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:53.031878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d76ebd-ff2f-4f9b-8717-297bf49e1892 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:53.032151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d76ebd-ff2f-4f9b-8717-297bf49e1892 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:53.032417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d76ebd-ff2f-4f9b-8717-297bf49e1892 None admin] PATH_INFO: `/v3/users/1bb396ea76774fe4872648519d7f4f84` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:53.045564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d76ebd-ff2f-4f9b-8717-297bf49e1892 None admin] RBAC: Authorizing `identity:get_user(user_id=1bb396ea76774fe4872648519d7f4f84)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:53.047019 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d76ebd-ff2f-4f9b-8717-297bf49e1892 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:53.048609 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 599/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:52 2022] GET /identity/v3/users/1bb396ea76774fe4872648519d7f4f84 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:53.055193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097b364-e3c0-49bb-8e0f-e9502b214ed8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:53.124564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:53.152840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097b364-e3c0-49bb-8e0f-e9502b214ed8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:53.186463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416b548-c57e-4265-bd32-0ebd2b80f4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:53.187060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b548-c57e-4265-bd32-0ebd2b80f4ca None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:53.187329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b548-c57e-4265-bd32-0ebd2b80f4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:53.187591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b548-c57e-4265-bd32-0ebd2b80f4ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:53.253463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416b548-c57e-4265-bd32-0ebd2b80f4ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:53.254884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416b548-c57e-4265-bd32-0ebd2b80f4ca None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:53.322389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:53.350703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 584/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:07:53.356790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d76ebd-ff2f-4f9b-8717-297bf49e1892 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:53.425232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:53.457979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d76ebd-ff2f-4f9b-8717-297bf49e1892 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:53.489855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c7d10-9d84-40b8-916d-a019e405ce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:53.490464 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c7d10-9d84-40b8-916d-a019e405ce39 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:53.490737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c7d10-9d84-40b8-916d-a019e405ce39 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:53.491002 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c7d10-9d84-40b8-916d-a019e405ce39 None admin] PATH_INFO: `/v3/projects/1a718da42801462e95211f8de98cf594` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:53.492078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c7d10-9d84-40b8-916d-a019e405ce39 None admin] RBAC: Authorizing `identity:get_project(project_id=1a718da42801462e95211f8de98cf594)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:53.493525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c7d10-9d84-40b8-916d-a019e405ce39 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:53.495114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 600/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:53 2022] GET /identity/v3/projects/1a718da42801462e95211f8de98cf594 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:53.501158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416b548-c57e-4265-bd32-0ebd2b80f4ca None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:53.599584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416b548-c57e-4265-bd32-0ebd2b80f4ca None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:53.633233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4917c7-f475-4f4f-9692-c04cdea9460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:53.633852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4917c7-f475-4f4f-9692-c04cdea9460f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:53.634126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4917c7-f475-4f4f-9692-c04cdea9460f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:53.634390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4917c7-f475-4f4f-9692-c04cdea9460f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:53.635100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4917c7-f475-4f4f-9692-c04cdea9460f None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=1a718da42801462e95211f8de98cf594, user.id=1bb396ea76774fe4872648519d7f4f84) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:53.635399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4917c7-f475-4f4f-9692-c04cdea9460f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:53.636816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4917c7-f475-4f4f-9692-c04cdea9460f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:53.641996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 585/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:07:53 2022] GET /identity/v3/role_assignments?user.id=1bb396ea76774fe4872648519d7f4f84&scope.project.id=1a718da42801462e95211f8de98cf594&role.id=28beda93f70d4c549352145ddee01aac => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:55.510239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763bc0a-e6d1-4194-a342-a32c4e3953e1 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:55.510832 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763bc0a-e6d1-4194-a342-a32c4e3953e1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:55.510832 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763bc0a-e6d1-4194-a342-a32c4e3953e1 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:55.512098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 601/1186] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:55.517172 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cd72f-54fb-4cb2-bae4-f9cf0e4d4ebb None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:55.517660 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cd72f-54fb-4cb2-bae4-f9cf0e4d4ebb None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:55.518030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cd72f-54fb-4cb2-bae4-f9cf0e4d4ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:55.537504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9b3cd72f-54fb-4cb2-bae4-f9cf0e4d4ebb None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:55.538694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9b3cd72f-54fb-4cb2-bae4-f9cf0e4d4ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:55.567976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:55.604644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 586/1187] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:55.870621 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763bc0a-e6d1-4194-a342-a32c4e3953e1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:55.969557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763bc0a-e6d1-4194-a342-a32c4e3953e1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:56.002458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11881e-4946-4791-873f-0816420792ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:56.003071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11881e-4946-4791-873f-0816420792ec None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:56.003342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11881e-4946-4791-873f-0816420792ec None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:56.003624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11881e-4946-4791-873f-0816420792ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:56.006292 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:56.013819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11881e-4946-4791-873f-0816420792ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7c11881e-4946-4791-873f-0816420792ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:56.019157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:56.020359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:07:56.021444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 602/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:07:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:56.026355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cd72f-54fb-4cb2-bae4-f9cf0e4d4ebb None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:56.122245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cd72f-54fb-4cb2-bae4-f9cf0e4d4ebb None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:56.155470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e128eb-2f92-49bf-8b50-0a31b7623eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:56.156069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e128eb-2f92-49bf-8b50-0a31b7623eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:56.156341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e128eb-2f92-49bf-8b50-0a31b7623eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:56.156607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e128eb-2f92-49bf-8b50-0a31b7623eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:56.157256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e128eb-2f92-49bf-8b50-0a31b7623eb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:56.157580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e128eb-2f92-49bf-8b50-0a31b7623eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:56.159003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e128eb-2f92-49bf-8b50-0a31b7623eb6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:56.166859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 587/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:07:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:56.172564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11881e-4946-4791-873f-0816420792ec None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:56.268742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11881e-4946-4791-873f-0816420792ec None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:56.300869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda36ba-101b-4f75-9a4d-671c821f04b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:56.301497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda36ba-101b-4f75-9a4d-671c821f04b9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:56.301783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda36ba-101b-4f75-9a4d-671c821f04b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:56.302035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda36ba-101b-4f75-9a4d-671c821f04b9 None admin] PATH_INFO: `/v3/users/1bb396ea76774fe4872648519d7f4f84` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:56.303113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda36ba-101b-4f75-9a4d-671c821f04b9 None admin] RBAC: Authorizing `identity:get_user(user_id=1bb396ea76774fe4872648519d7f4f84)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:56.304539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda36ba-101b-4f75-9a4d-671c821f04b9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:56.306087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 603/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:56 2022] GET /identity/v3/users/1bb396ea76774fe4872648519d7f4f84 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:56.311694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e128eb-2f92-49bf-8b50-0a31b7623eb6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:56.340600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:56.411084 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e128eb-2f92-49bf-8b50-0a31b7623eb6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:56.443938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a4edd-dc5c-4d0c-8e70-c4912fcfe884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:56.444559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4edd-dc5c-4d0c-8e70-c4912fcfe884 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:56.444841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4edd-dc5c-4d0c-8e70-c4912fcfe884 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:56.445111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4edd-dc5c-4d0c-8e70-c4912fcfe884 None admin] PATH_INFO: `/v3/projects/1a718da42801462e95211f8de98cf594` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:56.446244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a4edd-dc5c-4d0c-8e70-c4912fcfe884 None admin] RBAC: Authorizing `identity:get_project(project_id=1a718da42801462e95211f8de98cf594)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:56.447666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a4edd-dc5c-4d0c-8e70-c4912fcfe884 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:56.449275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 588/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:56 2022] GET /identity/v3/projects/1a718da42801462e95211f8de98cf594 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:07:56.455940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda36ba-101b-4f75-9a4d-671c821f04b9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:56.514870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:56.552180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda36ba-101b-4f75-9a4d-671c821f04b9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:56.584769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c0913-37f2-47d5-a862-8e61f490a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:56.585422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c0913-37f2-47d5-a862-8e61f490a00b None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:56.585699 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c0913-37f2-47d5-a862-8e61f490a00b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:56.585967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c0913-37f2-47d5-a862-8e61f490a00b None admin] PATH_INFO: `/v3/projects/1a718da42801462e95211f8de98cf594/users/1bb396ea76774fe4872648519d7f4f84/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:56.587813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c0913-37f2-47d5-a862-8e61f490a00b None admin] RBAC: Authorizing `identity:create_grant(project_id=1a718da42801462e95211f8de98cf594, user_id=1bb396ea76774fe4872648519d7f4f84, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:56.589253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c0913-37f2-47d5-a862-8e61f490a00b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:56.643697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 604/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:07:56 2022] PUT /identity/v3/projects/1a718da42801462e95211f8de98cf594/users/1bb396ea76774fe4872648519d7f4f84/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:07:58.518673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370daa-bb56-4c69-8cb2-3932a66580d0 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:58.519227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370daa-bb56-4c69-8cb2-3932a66580d0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:58.519227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370daa-bb56-4c69-8cb2-3932a66580d0 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:58.520555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 589/1193] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:58.525868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f989c5-9295-43a3-b533-cc93b80784b6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:58.526267 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f989c5-9295-43a3-b533-cc93b80784b6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:58.526422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f989c5-9295-43a3-b533-cc93b80784b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:58.544823 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-56f989c5-9295-43a3-b533-cc93b80784b6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:58.546032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-56f989c5-9295-43a3-b533-cc93b80784b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:58.611750 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 605/1194] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:07:58.878443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa370daa-bb56-4c69-8cb2-3932a66580d0 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:58.971416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:58.977761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa370daa-bb56-4c69-8cb2-3932a66580d0 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:59.011110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9ef08-65c9-4711-9b8e-3f7f14efbe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:59.011826 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9ef08-65c9-4711-9b8e-3f7f14efbe1e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:59.012097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9ef08-65c9-4711-9b8e-3f7f14efbe1e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:59.012361 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9ef08-65c9-4711-9b8e-3f7f14efbe1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:59.022207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9ef08-65c9-4711-9b8e-3f7f14efbe1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-7df9ef08-65c9-4711-9b8e-3f7f14efbe1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:07:59.026908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:07:59.028034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:07:59.028889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 590/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:07:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:07:59.034600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f989c5-9295-43a3-b533-cc93b80784b6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:59.087545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:59.131455 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f989c5-9295-43a3-b533-cc93b80784b6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:59.164523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba292b8-9105-4928-b965-b2b78f03921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:59.165125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba292b8-9105-4928-b965-b2b78f03921c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:59.165424 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba292b8-9105-4928-b965-b2b78f03921c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:59.165698 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba292b8-9105-4928-b965-b2b78f03921c None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:59.166356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba292b8-9105-4928-b965-b2b78f03921c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:59.166653 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba292b8-9105-4928-b965-b2b78f03921c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:59.168013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba292b8-9105-4928-b965-b2b78f03921c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:59.176868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 606/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:07:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:59.182740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9ef08-65c9-4711-9b8e-3f7f14efbe1e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:59.282562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9ef08-65c9-4711-9b8e-3f7f14efbe1e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:59.316268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575893d6-9f40-44ab-988d-f9330e0bc3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:59.316876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575893d6-9f40-44ab-988d-f9330e0bc3ac None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:59.317154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575893d6-9f40-44ab-988d-f9330e0bc3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:59.317450 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575893d6-9f40-44ab-988d-f9330e0bc3ac None admin] PATH_INFO: `/v3/users/1bb396ea76774fe4872648519d7f4f84` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:59.318568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575893d6-9f40-44ab-988d-f9330e0bc3ac None admin] RBAC: Authorizing `identity:get_user(user_id=1bb396ea76774fe4872648519d7f4f84)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:59.319990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575893d6-9f40-44ab-988d-f9330e0bc3ac None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:59.321566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 591/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 17 16:07:59 2022] GET /identity/v3/users/1bb396ea76774fe4872648519d7f4f84 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:59.327277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba292b8-9105-4928-b965-b2b78f03921c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:59.423994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba292b8-9105-4928-b965-b2b78f03921c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:59.439746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:59.457585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bca82-e369-4b7d-9222-0dd3db74380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:59.458180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bca82-e369-4b7d-9222-0dd3db74380e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:59.458457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bca82-e369-4b7d-9222-0dd3db74380e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:59.458724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bca82-e369-4b7d-9222-0dd3db74380e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:59.528180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bca82-e369-4b7d-9222-0dd3db74380e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:59.529661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bca82-e369-4b7d-9222-0dd3db74380e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:59.623676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 607/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:07:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:07:59.630318 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575893d6-9f40-44ab-988d-f9330e0bc3ac None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:59.656492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:59.729428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575893d6-9f40-44ab-988d-f9330e0bc3ac None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:59.762181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ae45a-4e00-4407-aac3-8df2a83f591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:59.762795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ae45a-4e00-4407-aac3-8df2a83f591b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:59.763069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ae45a-4e00-4407-aac3-8df2a83f591b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:59.763334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ae45a-4e00-4407-aac3-8df2a83f591b None admin] PATH_INFO: `/v3/projects/1a718da42801462e95211f8de98cf594` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:59.764421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ae45a-4e00-4407-aac3-8df2a83f591b None admin] RBAC: Authorizing `identity:get_project(project_id=1a718da42801462e95211f8de98cf594)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:59.765873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ae45a-4e00-4407-aac3-8df2a83f591b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:59.768289 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 592/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 17 16:07:59 2022] GET /identity/v3/projects/1a718da42801462e95211f8de98cf594 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:07:59.774067 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bca82-e369-4b7d-9222-0dd3db74380e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:59.790866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:59.869740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bca82-e369-4b7d-9222-0dd3db74380e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:59.903269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899e4db-25f7-416d-8a84-3cd9f1ad5989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:59.903864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899e4db-25f7-416d-8a84-3cd9f1ad5989 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:59.904134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899e4db-25f7-416d-8a84-3cd9f1ad5989 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:59.904395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899e4db-25f7-416d-8a84-3cd9f1ad5989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:59.905104 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899e4db-25f7-416d-8a84-3cd9f1ad5989 None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=1a718da42801462e95211f8de98cf594, user.id=1bb396ea76774fe4872648519d7f4f84) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:07:59.905431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899e4db-25f7-416d-8a84-3cd9f1ad5989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:59.906850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899e4db-25f7-416d-8a84-3cd9f1ad5989 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:59.912599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 608/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:07:59 2022] GET /identity/v3/role_assignments?user.id=1bb396ea76774fe4872648519d7f4f84&scope.project.id=1a718da42801462e95211f8de98cf594&role.id=28beda93f70d4c549352145ddee01aac => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:08:09.758157 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=54 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:09.910079 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=60 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:10.346995 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1092f25-5dc6-419d-b061-925d36e57995 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:10.347542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1092f25-5dc6-419d-b061-925d36e57995 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:10.347542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1092f25-5dc6-419d-b061-925d36e57995 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:10.348954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 593/1201] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:10.354229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b93c0-ab6d-401d-81d8-c8d78bbe1e26 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:10.354654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b93c0-ab6d-401d-81d8-c8d78bbe1e26 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:10.354789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b93c0-ab6d-401d-81d8-c8d78bbe1e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:10.372903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-742b93c0-ab6d-401d-81d8-c8d78bbe1e26 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:10.374362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-742b93c0-ab6d-401d-81d8-c8d78bbe1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:10.439496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 609/1202] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:09:10.710990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1092f25-5dc6-419d-b061-925d36e57995 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:10.811079 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1092f25-5dc6-419d-b061-925d36e57995 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:10.844253 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ce35c-865e-4264-b3e6-9d125964649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:10.844947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ce35c-865e-4264-b3e6-9d125964649f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:10.845227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ce35c-865e-4264-b3e6-9d125964649f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:10.845529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ce35c-865e-4264-b3e6-9d125964649f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:10.855671 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ce35c-865e-4264-b3e6-9d125964649f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:10.857128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ce35c-865e-4264-b3e6-9d125964649f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-189ce35c-865e-4264-b3e6-9d125964649f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:10.872149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:10.873352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:10.874383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:10.874383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:10.874383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:10.874383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 594/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:10.879961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b93c0-ab6d-401d-81d8-c8d78bbe1e26 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:10.979090 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b93c0-ab6d-401d-81d8-c8d78bbe1e26 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:11.006543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:11.012393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d20d4b-523c-468f-840e-8b977323a1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:11.013003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d20d4b-523c-468f-840e-8b977323a1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:11.013280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d20d4b-523c-468f-840e-8b977323a1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:11.013600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d20d4b-523c-468f-840e-8b977323a1d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:11.014268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d20d4b-523c-468f-840e-8b977323a1d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:11.014655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d20d4b-523c-468f-840e-8b977323a1d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:11.016082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d20d4b-523c-468f-840e-8b977323a1d0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:11.028036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 610/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:11.034041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ce35c-865e-4264-b3e6-9d125964649f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:11.088002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:11.133435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ce35c-865e-4264-b3e6-9d125964649f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:11.166905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4ecdd-250f-4b47-bed4-7b10b17f6947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:11.167507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4ecdd-250f-4b47-bed4-7b10b17f6947 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:11.167782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4ecdd-250f-4b47-bed4-7b10b17f6947 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:11.168050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4ecdd-250f-4b47-bed4-7b10b17f6947 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:11.168673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4ecdd-250f-4b47-bed4-7b10b17f6947 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:11.170154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4ecdd-250f-4b47-bed4-7b10b17f6947 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:11.253334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 595/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 17 16:09:11 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:09:13.186703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599570-3cf4-468d-9ee6-c2e9b6e2fdeb None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:13.187259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599570-3cf4-468d-9ee6-c2e9b6e2fdeb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:13.187259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599570-3cf4-468d-9ee6-c2e9b6e2fdeb None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:13.188511 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 611/1206] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:13.194425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea53590-c01c-4079-b1a4-bb2508408f52 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:13.194863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea53590-c01c-4079-b1a4-bb2508408f52 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:13.194956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea53590-c01c-4079-b1a4-bb2508408f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:13.212659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-aea53590-c01c-4079-b1a4-bb2508408f52 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:13.213852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-aea53590-c01c-4079-b1a4-bb2508408f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:13.278871 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 596/1207] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:09:13.550755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599570-3cf4-468d-9ee6-c2e9b6e2fdeb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:13.652450 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599570-3cf4-468d-9ee6-c2e9b6e2fdeb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:13.685974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfc149-4370-40ce-a107-01d84ba11c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:13.686599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfc149-4370-40ce-a107-01d84ba11c9c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:13.686873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfc149-4370-40ce-a107-01d84ba11c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:13.687141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfc149-4370-40ce-a107-01d84ba11c9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:13.697884 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfc149-4370-40ce-a107-01d84ba11c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f0bfc149-4370-40ce-a107-01d84ba11c9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:09:13.702538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:13.703708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:13.704755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 612/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:09:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:13.710275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea53590-c01c-4079-b1a4-bb2508408f52 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:13.751462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:13.811529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea53590-c01c-4079-b1a4-bb2508408f52 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:13.844777 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9d620-5752-4162-9475-c4f43557acbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:13.845392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9d620-5752-4162-9475-c4f43557acbc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:13.845669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9d620-5752-4162-9475-c4f43557acbc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:13.845934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9d620-5752-4162-9475-c4f43557acbc None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:13.846586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9d620-5752-4162-9475-c4f43557acbc None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:13.846922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9d620-5752-4162-9475-c4f43557acbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:13.848926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9d620-5752-4162-9475-c4f43557acbc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:13.856880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 597/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:09:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:13.862722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfc149-4370-40ce-a107-01d84ba11c9c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:13.913893 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:13.964146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfc149-4370-40ce-a107-01d84ba11c9c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:13.998080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece90ec6-2974-4ce8-8c89-c82fc5390a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:13.998705 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece90ec6-2974-4ce8-8c89-c82fc5390a21 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:13.998980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece90ec6-2974-4ce8-8c89-c82fc5390a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:13.999252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece90ec6-2974-4ce8-8c89-c82fc5390a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:14.009664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece90ec6-2974-4ce8-8c89-c82fc5390a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:14.011163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece90ec6-2974-4ce8-8c89-c82fc5390a21 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ece90ec6-2974-4ce8-8c89-c82fc5390a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:14.025689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:14.026838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:14.028191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:14.028191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:14.028191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:14.028191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 613/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:14.032845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9d620-5752-4162-9475-c4f43557acbc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:14.134689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:14.137535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9d620-5752-4162-9475-c4f43557acbc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:14.171752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114e63c-31cc-4f82-b968-e8c3a64866ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:14.172349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e63c-31cc-4f82-b968-e8c3a64866ce None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:14.172622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e63c-31cc-4f82-b968-e8c3a64866ce None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:14.173008 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e63c-31cc-4f82-b968-e8c3a64866ce None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:14.173670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114e63c-31cc-4f82-b968-e8c3a64866ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:14.173968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114e63c-31cc-4f82-b968-e8c3a64866ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:14.175334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114e63c-31cc-4f82-b968-e8c3a64866ce None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:14.186673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 598/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:14.193045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece90ec6-2974-4ce8-8c89-c82fc5390a21 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:14.292591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece90ec6-2974-4ce8-8c89-c82fc5390a21 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:14.294155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:14.326013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c29aa8-3e2f-487c-84e3-73b41295efe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:14.326635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29aa8-3e2f-487c-84e3-73b41295efe3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:14.326911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29aa8-3e2f-487c-84e3-73b41295efe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:14.327181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29aa8-3e2f-487c-84e3-73b41295efe3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:14.334507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c29aa8-3e2f-487c-84e3-73b41295efe3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:14.335940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c29aa8-3e2f-487c-84e3-73b41295efe3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c7c29aa8-3e2f-487c-84e3-73b41295efe3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:09:14.347577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:14.348748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:14.350100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:14.350100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:14.350100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:09:14.350100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:09:14.350100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:09:14.350100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:09:14.350100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:09:14.350100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:09:14.350100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:14.350100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:14.350100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 614/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:14.354659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114e63c-31cc-4f82-b968-e8c3a64866ce None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:14.454041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114e63c-31cc-4f82-b968-e8c3a64866ce None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:14.486379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90074db4-2429-4060-83a6-6b918fd79b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:14.486976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90074db4-2429-4060-83a6-6b918fd79b79 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:14.487248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90074db4-2429-4060-83a6-6b918fd79b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:14.487512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90074db4-2429-4060-83a6-6b918fd79b79 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:14.488221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90074db4-2429-4060-83a6-6b918fd79b79 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:14.489061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90074db4-2429-4060-83a6-6b918fd79b79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:14.490480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90074db4-2429-4060-83a6-6b918fd79b79 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:14.507663 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 599/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 17 16:09:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:14.513518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c29aa8-3e2f-487c-84e3-73b41295efe3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:14.613149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c29aa8-3e2f-487c-84e3-73b41295efe3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:14.646486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218633c1-845e-4647-bb2f-ee15252d8cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:14.647076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218633c1-845e-4647-bb2f-ee15252d8cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:14.647348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218633c1-845e-4647-bb2f-ee15252d8cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:14.647655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218633c1-845e-4647-bb2f-ee15252d8cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:14.676449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:14.714950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218633c1-845e-4647-bb2f-ee15252d8cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:14.716344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218633c1-845e-4647-bb2f-ee15252d8cb6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:14.812154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 615/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:09:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:09:14.818659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90074db4-2429-4060-83a6-6b918fd79b79 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:14.838897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:14.919137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90074db4-2429-4060-83a6-6b918fd79b79 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:14.953013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634037f-032f-4ac0-adf5-639e3cc00393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:14.953674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634037f-032f-4ac0-adf5-639e3cc00393 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:14.953951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634037f-032f-4ac0-adf5-639e3cc00393 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:14.954218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634037f-032f-4ac0-adf5-639e3cc00393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:14.964553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634037f-032f-4ac0-adf5-639e3cc00393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:14.966104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634037f-032f-4ac0-adf5-639e3cc00393 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-e634037f-032f-4ac0-adf5-639e3cc00393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:14.982767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:14.983902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:14.984983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:14.984983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:14.984983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:14.984983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 600/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:14.989966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218633c1-845e-4647-bb2f-ee15252d8cb6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:15.048458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:15.086839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218633c1-845e-4647-bb2f-ee15252d8cb6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:15.119580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161fa97-b161-47c6-b670-9eaa040ef4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:15.120177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161fa97-b161-47c6-b670-9eaa040ef4de None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:15.120451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161fa97-b161-47c6-b670-9eaa040ef4de None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:15.120720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161fa97-b161-47c6-b670-9eaa040ef4de None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:15.121351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161fa97-b161-47c6-b670-9eaa040ef4de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:15.121679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161fa97-b161-47c6-b670-9eaa040ef4de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:15.123045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161fa97-b161-47c6-b670-9eaa040ef4de None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:15.135190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 616/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:09:15.140855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634037f-032f-4ac0-adf5-639e3cc00393 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:15.209738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:15.239824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634037f-032f-4ac0-adf5-639e3cc00393 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:15.272793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f0bd1-e967-4a20-9c10-721c6bf115f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:15.273427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f0bd1-e967-4a20-9c10-721c6bf115f0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:15.273703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f0bd1-e967-4a20-9c10-721c6bf115f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:15.273968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f0bd1-e967-4a20-9c10-721c6bf115f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:15.280316 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f0bd1-e967-4a20-9c10-721c6bf115f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:15.281744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f0bd1-e967-4a20-9c10-721c6bf115f0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-043f0bd1-e967-4a20-9c10-721c6bf115f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:09:15.292407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:15.297576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:15.298976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:09:15.298976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:09:15.298976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:09:15.298976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:09:15.298976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:09:15.298976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:09:15.298976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:15.298976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:15.298976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 601/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:09:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:15.299613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161fa97-b161-47c6-b670-9eaa040ef4de None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:15.398026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161fa97-b161-47c6-b670-9eaa040ef4de None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:15.420494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:15.432072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90de1c-415c-436b-9a04-ae35d86e9ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:15.432666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90de1c-415c-436b-9a04-ae35d86e9ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:15.432938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90de1c-415c-436b-9a04-ae35d86e9ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:15.433489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90de1c-415c-436b-9a04-ae35d86e9ab3 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:15.434167 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90de1c-415c-436b-9a04-ae35d86e9ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:15.434462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90de1c-415c-436b-9a04-ae35d86e9ab3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:15.435872 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90de1c-415c-436b-9a04-ae35d86e9ab3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:15.447563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 617/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:09:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:15.454215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f0bd1-e967-4a20-9c10-721c6bf115f0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:15.555896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f0bd1-e967-4a20-9c10-721c6bf115f0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:15.584058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:15.590000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10800f5d-92ab-4060-82ff-00f17c6cc113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:15.590604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10800f5d-92ab-4060-82ff-00f17c6cc113 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:15.590874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10800f5d-92ab-4060-82ff-00f17c6cc113 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:15.591136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10800f5d-92ab-4060-82ff-00f17c6cc113 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:15.591885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10800f5d-92ab-4060-82ff-00f17c6cc113 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=da5e1da2196b4ff399921809f40d3002) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:15.592178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10800f5d-92ab-4060-82ff-00f17c6cc113 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:15.593637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10800f5d-92ab-4060-82ff-00f17c6cc113 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:15.599352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 602/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:09:15 2022] GET /identity/v3/role_assignments?user.id=da5e1da2196b4ff399921809f40d3002&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:17.475491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5d9b-77b5-4d33-805b-9b0ae5476357 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:17.476050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5d9b-77b5-4d33-805b-9b0ae5476357 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:17.476050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5d9b-77b5-4d33-805b-9b0ae5476357 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:17.477406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 618/1220] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:17.482487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c4b0f-93cb-4cd7-87dc-b09ff4cc244e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:17.482907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c4b0f-93cb-4cd7-87dc-b09ff4cc244e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:17.483060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c4b0f-93cb-4cd7-87dc-b09ff4cc244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:17.501597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9c1c4b0f-93cb-4cd7-87dc-b09ff4cc244e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:17.502788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9c1c4b0f-93cb-4cd7-87dc-b09ff4cc244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:17.570357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 603/1221] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:09:17.842781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5d9b-77b5-4d33-805b-9b0ae5476357 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:17.946934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5d9b-77b5-4d33-805b-9b0ae5476357 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:17.980153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288437e-4b4f-46c7-b74b-5318187a1666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:17.980771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288437e-4b4f-46c7-b74b-5318187a1666 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:17.981047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288437e-4b4f-46c7-b74b-5318187a1666 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:17.981316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288437e-4b4f-46c7-b74b-5318187a1666 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:17.991307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288437e-4b4f-46c7-b74b-5318187a1666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c288437e-4b4f-46c7-b74b-5318187a1666 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:09:17.995914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:17.996914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:18.002775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 619/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:09:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:18.004254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c4b0f-93cb-4cd7-87dc-b09ff4cc244e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:18.101978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c4b0f-93cb-4cd7-87dc-b09ff4cc244e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:18.124401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:18.136205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe53c94-be29-4171-8392-a08fee4c9a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:18.136833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe53c94-be29-4171-8392-a08fee4c9a54 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:18.137105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe53c94-be29-4171-8392-a08fee4c9a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:18.137389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe53c94-be29-4171-8392-a08fee4c9a54 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:18.138049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe53c94-be29-4171-8392-a08fee4c9a54 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:18.138344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe53c94-be29-4171-8392-a08fee4c9a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:18.139815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe53c94-be29-4171-8392-a08fee4c9a54 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:18.148453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 604/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:09:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:18.154053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288437e-4b4f-46c7-b74b-5318187a1666 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:18.199351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:18.258228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288437e-4b4f-46c7-b74b-5318187a1666 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:18.291956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99149c-60ac-487b-9231-a2b53b18a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:18.292575 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99149c-60ac-487b-9231-a2b53b18a828 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:18.292855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99149c-60ac-487b-9231-a2b53b18a828 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:18.293117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99149c-60ac-487b-9231-a2b53b18a828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:18.303522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99149c-60ac-487b-9231-a2b53b18a828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:18.304970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99149c-60ac-487b-9231-a2b53b18a828 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2d99149c-60ac-487b-9231-a2b53b18a828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:18.319970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:18.321121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:18.322178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:18.322178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:18.322178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:18.322178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 620/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:18.327067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe53c94-be29-4171-8392-a08fee4c9a54 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:18.427771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe53c94-be29-4171-8392-a08fee4c9a54 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:18.461074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bbd9e-1775-4fc8-9f05-5305e7735ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:18.461698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bbd9e-1775-4fc8-9f05-5305e7735ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:18.461974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bbd9e-1775-4fc8-9f05-5305e7735ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:18.462239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bbd9e-1775-4fc8-9f05-5305e7735ca9 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:18.462865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bbd9e-1775-4fc8-9f05-5305e7735ca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:18.463162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bbd9e-1775-4fc8-9f05-5305e7735ca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:18.464514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bbd9e-1775-4fc8-9f05-5305e7735ca9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:18.476091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 605/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:18.481990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99149c-60ac-487b-9231-a2b53b18a828 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:18.575367 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:18.581607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99149c-60ac-487b-9231-a2b53b18a828 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:18.615377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae07d6-470b-4c1a-a7cc-89f0b497d9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:18.615998 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae07d6-470b-4c1a-a7cc-89f0b497d9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:18.616272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae07d6-470b-4c1a-a7cc-89f0b497d9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:18.616541 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae07d6-470b-4c1a-a7cc-89f0b497d9f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:18.623217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae07d6-470b-4c1a-a7cc-89f0b497d9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:18.624667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae07d6-470b-4c1a-a7cc-89f0b497d9f5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-20ae07d6-470b-4c1a-a7cc-89f0b497d9f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:09:18.636095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:18.637215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:18.639834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:18.639834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:18.639834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:09:18.639834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:09:18.639834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:09:18.639834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:09:18.639834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:09:18.639834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:09:18.639834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:18.639834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:18.639834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 621/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:18.644606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bbd9e-1775-4fc8-9f05-5305e7735ca9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:18.693632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:18.745914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bbd9e-1775-4fc8-9f05-5305e7735ca9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:18.779802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b095bd-643f-4948-8889-f557443ea894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:18.780402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b095bd-643f-4948-8889-f557443ea894 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:18.780678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b095bd-643f-4948-8889-f557443ea894 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:18.780946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b095bd-643f-4948-8889-f557443ea894 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:18.781688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b095bd-643f-4948-8889-f557443ea894 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:18.781987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b095bd-643f-4948-8889-f557443ea894 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:18.783408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b095bd-643f-4948-8889-f557443ea894 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:18.801680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 606/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 17 16:09:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:18.807352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae07d6-470b-4c1a-a7cc-89f0b497d9f5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:18.904859 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae07d6-470b-4c1a-a7cc-89f0b497d9f5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:18.938415 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9ab97-c5f6-4da9-ba73-d6ca481495e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:18.939029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ab97-c5f6-4da9-ba73-d6ca481495e1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:18.939301 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ab97-c5f6-4da9-ba73-d6ca481495e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:18.939569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ab97-c5f6-4da9-ba73-d6ca481495e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:18.956603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9ab97-c5f6-4da9-ba73-d6ca481495e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:18.956603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9ab97-c5f6-4da9-ba73-d6ca481495e1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-bae9ab97-c5f6-4da9-ba73-d6ca481495e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:18.965933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:18.967065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:18.968301 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:18.968301 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:18.968301 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:18.968301 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 622/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:18.973798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b095bd-643f-4948-8889-f557443ea894 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:19.073304 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b095bd-643f-4948-8889-f557443ea894 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:19.075603 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:19.106687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b881f8c-d4f2-4a22-9dac-18c35237a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:19.107418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b881f8c-d4f2-4a22-9dac-18c35237a977 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:19.107686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b881f8c-d4f2-4a22-9dac-18c35237a977 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:19.107947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b881f8c-d4f2-4a22-9dac-18c35237a977 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:19.108611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b881f8c-d4f2-4a22-9dac-18c35237a977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:19.108937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b881f8c-d4f2-4a22-9dac-18c35237a977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:19.110311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b881f8c-d4f2-4a22-9dac-18c35237a977 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:19.122225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 607/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:19.128112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9ab97-c5f6-4da9-ba73-d6ca481495e1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:19.138097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:19.225623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9ab97-c5f6-4da9-ba73-d6ca481495e1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:19.258744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c72c1-e449-48a4-ac5c-ed8d73c88d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:19.259359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c72c1-e449-48a4-ac5c-ed8d73c88d50 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:19.259633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c72c1-e449-48a4-ac5c-ed8d73c88d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:19.259899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c72c1-e449-48a4-ac5c-ed8d73c88d50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:19.266232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c72c1-e449-48a4-ac5c-ed8d73c88d50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:19.267688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c72c1-e449-48a4-ac5c-ed8d73c88d50 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-445c72c1-e449-48a4-ac5c-ed8d73c88d50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:09:19.278380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:19.280172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:19.281293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:09:19.281293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:09:19.281293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:09:19.281293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:09:19.281293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:09:19.281293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:09:19.281293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:19.281293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:19.281293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 623/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:19.286147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b881f8c-d4f2-4a22-9dac-18c35237a977 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:19.385342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b881f8c-d4f2-4a22-9dac-18c35237a977 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:19.418393 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dde2a-adc1-4e8e-a402-c61e74141558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:19.418991 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dde2a-adc1-4e8e-a402-c61e74141558 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:19.419287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dde2a-adc1-4e8e-a402-c61e74141558 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:19.419563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dde2a-adc1-4e8e-a402-c61e74141558 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:19.420240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dde2a-adc1-4e8e-a402-c61e74141558 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:19.420540 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dde2a-adc1-4e8e-a402-c61e74141558 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:19.421976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dde2a-adc1-4e8e-a402-c61e74141558 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:19.434674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 608/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:19.440636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c72c1-e449-48a4-ac5c-ed8d73c88d50 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:19.505943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:19.539583 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c72c1-e449-48a4-ac5c-ed8d73c88d50 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:19.572752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214abf5-b219-4863-ad34-d88503fb6ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:19.573516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214abf5-b219-4863-ad34-d88503fb6ca4 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:19.573795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214abf5-b219-4863-ad34-d88503fb6ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:19.574065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214abf5-b219-4863-ad34-d88503fb6ca4 None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/da5e1da2196b4ff399921809f40d3002/roles/2da610f1e24748d597d353508d98c21e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:19.588773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214abf5-b219-4863-ad34-d88503fb6ca4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=da5e1da2196b4ff399921809f40d3002, role_id=2da610f1e24748d597d353508d98c21e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:19.590319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214abf5-b219-4863-ad34-d88503fb6ca4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:19.666906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 624/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:09:19 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/da5e1da2196b4ff399921809f40d3002/roles/2da610f1e24748d597d353508d98c21e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:09:21.513901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c1d51-a1ac-435d-a8ef-a1f26f3699bc None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:21.514454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c1d51-a1ac-435d-a8ef-a1f26f3699bc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:21.514454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c1d51-a1ac-435d-a8ef-a1f26f3699bc None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:21.515767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 609/1233] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:21.521458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075abfd3-37a8-4ee3-b0b4-c02df0b46294 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:21.521838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075abfd3-37a8-4ee3-b0b4-c02df0b46294 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:21.523625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075abfd3-37a8-4ee3-b0b4-c02df0b46294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:21.540169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-075abfd3-37a8-4ee3-b0b4-c02df0b46294 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:21.541342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-075abfd3-37a8-4ee3-b0b4-c02df0b46294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:21.606722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 625/1234] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:09:21.873512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c1d51-a1ac-435d-a8ef-a1f26f3699bc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:21.899575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:21.977606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c1d51-a1ac-435d-a8ef-a1f26f3699bc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:22.011679 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a76b4-9cb7-40e3-895f-ef073dbba573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:22.012303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a76b4-9cb7-40e3-895f-ef073dbba573 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:22.012579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a76b4-9cb7-40e3-895f-ef073dbba573 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:22.012849 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a76b4-9cb7-40e3-895f-ef073dbba573 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:22.022969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a76b4-9cb7-40e3-895f-ef073dbba573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-6d3a76b4-9cb7-40e3-895f-ef073dbba573 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:09:22.027695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:22.028709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:22.029978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 610/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 17 16:09:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:22.035151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075abfd3-37a8-4ee3-b0b4-c02df0b46294 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:22.082597 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:22.134424 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075abfd3-37a8-4ee3-b0b4-c02df0b46294 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:22.166820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ce98c-58a7-42b9-b7ee-60e529c4b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:22.167415 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce98c-58a7-42b9-b7ee-60e529c4b910 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:22.167686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce98c-58a7-42b9-b7ee-60e529c4b910 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:22.167950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ce98c-58a7-42b9-b7ee-60e529c4b910 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:22.168596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ce98c-58a7-42b9-b7ee-60e529c4b910 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:22.168887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ce98c-58a7-42b9-b7ee-60e529c4b910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:22.170282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ce98c-58a7-42b9-b7ee-60e529c4b910 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:22.178466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 626/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 17 16:09:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:22.184611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a76b4-9cb7-40e3-895f-ef073dbba573 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:22.270590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:22.286625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a76b4-9cb7-40e3-895f-ef073dbba573 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:22.320785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47340b24-99ab-495c-a7d1-a924ff48ea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:22.321435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340b24-99ab-495c-a7d1-a924ff48ea34 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:22.321715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340b24-99ab-495c-a7d1-a924ff48ea34 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:22.322028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340b24-99ab-495c-a7d1-a924ff48ea34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:22.332713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47340b24-99ab-495c-a7d1-a924ff48ea34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:22.334212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47340b24-99ab-495c-a7d1-a924ff48ea34 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-47340b24-99ab-495c-a7d1-a924ff48ea34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:22.349061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:22.350206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:22.351349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:22.351349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:22.351349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:22.351349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 611/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:22.356185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ce98c-58a7-42b9-b7ee-60e529c4b910 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:22.453099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ce98c-58a7-42b9-b7ee-60e529c4b910 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:22.461984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:22.486181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71209f66-097f-4e5e-88a0-03bd02cf2cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:22.486778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209f66-097f-4e5e-88a0-03bd02cf2cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:22.487050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209f66-097f-4e5e-88a0-03bd02cf2cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:22.487316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209f66-097f-4e5e-88a0-03bd02cf2cf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:22.488587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71209f66-097f-4e5e-88a0-03bd02cf2cf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:22.488884 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71209f66-097f-4e5e-88a0-03bd02cf2cf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:22.490274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71209f66-097f-4e5e-88a0-03bd02cf2cf6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:22.501856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 627/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:22.507686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47340b24-99ab-495c-a7d1-a924ff48ea34 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:22.607771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47340b24-99ab-495c-a7d1-a924ff48ea34 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:22.641245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde51cf0-0138-4709-b94f-d47f20d34e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:22.641918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde51cf0-0138-4709-b94f-d47f20d34e0a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:22.642192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde51cf0-0138-4709-b94f-d47f20d34e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:22.642455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde51cf0-0138-4709-b94f-d47f20d34e0a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:22.645096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:22.649983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde51cf0-0138-4709-b94f-d47f20d34e0a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:22.651437 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde51cf0-0138-4709-b94f-d47f20d34e0a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-dde51cf0-0138-4709-b94f-d47f20d34e0a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:09:22.662724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:22.663845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:22.665081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:22.665081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:22.665081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:09:22.665081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:09:22.665081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:09:22.665081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:09:22.665081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:09:22.665081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:09:22.665081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:22.665081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:22.665081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 612/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:22.669716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71209f66-097f-4e5e-88a0-03bd02cf2cf6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:22.771646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71209f66-097f-4e5e-88a0-03bd02cf2cf6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:22.805039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5ee6c-11f1-473a-aa5e-60f334c183fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:22.805664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5ee6c-11f1-473a-aa5e-60f334c183fe None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:22.805943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5ee6c-11f1-473a-aa5e-60f334c183fe None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:22.806212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5ee6c-11f1-473a-aa5e-60f334c183fe None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:22.806927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5ee6c-11f1-473a-aa5e-60f334c183fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:22.807227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5ee6c-11f1-473a-aa5e-60f334c183fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:22.808917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5ee6c-11f1-473a-aa5e-60f334c183fe None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:22.825931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 628/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 17 16:09:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:22.832282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde51cf0-0138-4709-b94f-d47f20d34e0a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:22.930324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde51cf0-0138-4709-b94f-d47f20d34e0a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:22.963744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95e9d-3219-423d-a0f7-7cb193254366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:22.964345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95e9d-3219-423d-a0f7-7cb193254366 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:22.964617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95e9d-3219-423d-a0f7-7cb193254366 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:22.964884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95e9d-3219-423d-a0f7-7cb193254366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:23.025504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:23.031656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c95e9d-3219-423d-a0f7-7cb193254366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:23.033090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c95e9d-3219-423d-a0f7-7cb193254366 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:23.130645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 613/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:09:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:09:23.136525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5ee6c-11f1-473a-aa5e-60f334c183fe None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:23.163691 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:23.235312 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5ee6c-11f1-473a-aa5e-60f334c183fe None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:23.268861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab3b76-2f3c-4d84-b8b4-77b6b805da69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:23.270155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab3b76-2f3c-4d84-b8b4-77b6b805da69 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:23.270468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab3b76-2f3c-4d84-b8b4-77b6b805da69 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:23.270740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab3b76-2f3c-4d84-b8b4-77b6b805da69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:23.283620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab3b76-2f3c-4d84-b8b4-77b6b805da69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:23.283620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab3b76-2f3c-4d84-b8b4-77b6b805da69 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e6ab3b76-2f3c-4d84-b8b4-77b6b805da69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:23.295924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:23.296963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:23.297922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:23.297922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:23.297922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:23.297922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 629/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:23.303124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95e9d-3219-423d-a0f7-7cb193254366 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:23.395927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:23.401659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95e9d-3219-423d-a0f7-7cb193254366 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:23.435107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536694a-fa1a-41c5-bc3b-0ee37b37daec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:23.435698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536694a-fa1a-41c5-bc3b-0ee37b37daec None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:23.435976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536694a-fa1a-41c5-bc3b-0ee37b37daec None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:23.436243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536694a-fa1a-41c5-bc3b-0ee37b37daec None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:23.436871 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536694a-fa1a-41c5-bc3b-0ee37b37daec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:23.437166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536694a-fa1a-41c5-bc3b-0ee37b37daec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:23.438552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536694a-fa1a-41c5-bc3b-0ee37b37daec None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:23.449950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 614/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:23.455711 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab3b76-2f3c-4d84-b8b4-77b6b805da69 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:23.536308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:23.557944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab3b76-2f3c-4d84-b8b4-77b6b805da69 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:23.591918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cdc7-60d0-4f44-b4ee-11801aece912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:23.592618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cdc7-60d0-4f44-b4ee-11801aece912 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:23.593138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cdc7-60d0-4f44-b4ee-11801aece912 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:23.593848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cdc7-60d0-4f44-b4ee-11801aece912 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:23.600629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14cdc7-60d0-4f44-b4ee-11801aece912 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:23.602133 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14cdc7-60d0-4f44-b4ee-11801aece912 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6b14cdc7-60d0-4f44-b4ee-11801aece912 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:09:23.613394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:23.616270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:23.617334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:09:23.617334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:09:23.617334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:09:23.617334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:09:23.617334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:09:23.617334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:09:23.617334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:23.617334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:23.617334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 630/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:23.620500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536694a-fa1a-41c5-bc3b-0ee37b37daec None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:23.720176 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536694a-fa1a-41c5-bc3b-0ee37b37daec None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:23.753904 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece9079-3eda-475b-9f6e-0fb01a3006e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:23.754567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece9079-3eda-475b-9f6e-0fb01a3006e1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:23.754841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece9079-3eda-475b-9f6e-0fb01a3006e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:23.755111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece9079-3eda-475b-9f6e-0fb01a3006e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:23.755784 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece9079-3eda-475b-9f6e-0fb01a3006e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:23.756122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece9079-3eda-475b-9f6e-0fb01a3006e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:23.757585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece9079-3eda-475b-9f6e-0fb01a3006e1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:23.769352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 615/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:09:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:23.775524 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cdc7-60d0-4f44-b4ee-11801aece912 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:23.874921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cdc7-60d0-4f44-b4ee-11801aece912 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:23.908080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c859e-6ccf-45a9-8172-e26f2ac411c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:23.908687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c859e-6ccf-45a9-8172-e26f2ac411c3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:23.908992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c859e-6ccf-45a9-8172-e26f2ac411c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:23.909263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c859e-6ccf-45a9-8172-e26f2ac411c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:23.910675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c859e-6ccf-45a9-8172-e26f2ac411c3 None admin] RBAC: Adding query filter params (role.id=2da610f1e24748d597d353508d98c21e, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=da5e1da2196b4ff399921809f40d3002) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:23.910980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c859e-6ccf-45a9-8172-e26f2ac411c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:23.912409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c859e-6ccf-45a9-8172-e26f2ac411c3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:23.918216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 631/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:09:23 2022] GET /identity/v3/role_assignments?user.id=da5e1da2196b4ff399921809f40d3002&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=2da610f1e24748d597d353508d98c21e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:25.843870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70adee-61da-45ee-9950-373e339653a5 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:25.844425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70adee-61da-45ee-9950-373e339653a5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:25.844425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70adee-61da-45ee-9950-373e339653a5 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:25.845867 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 616/1247] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:25.852145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56d972-bef8-4d6f-9153-1f4d80d923d0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:25.852610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56d972-bef8-4d6f-9153-1f4d80d923d0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:25.852741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56d972-bef8-4d6f-9153-1f4d80d923d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:25.858996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:25.870939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8f56d972-bef8-4d6f-9153-1f4d80d923d0 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:25.872106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8f56d972-bef8-4d6f-9153-1f4d80d923d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:25.938851 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 632/1248] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:09:26.210977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70adee-61da-45ee-9950-373e339653a5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:26.229106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:26.313219 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70adee-61da-45ee-9950-373e339653a5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:26.348077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae4407-8c57-4521-b054-574ee00de4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:26.348667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae4407-8c57-4521-b054-574ee00de4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:26.348943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae4407-8c57-4521-b054-574ee00de4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:26.349212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae4407-8c57-4521-b054-574ee00de4e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:26.359506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae4407-8c57-4521-b054-574ee00de4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-5bae4407-8c57-4521-b054-574ee00de4e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:09:26.364191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:26.365152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:26.366314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 617/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:09:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:26.371375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56d972-bef8-4d6f-9153-1f4d80d923d0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:26.471255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56d972-bef8-4d6f-9153-1f4d80d923d0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:26.500192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:26.505311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe86e8-d638-4a87-a5cc-eb4a112c16ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:26.506050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe86e8-d638-4a87-a5cc-eb4a112c16ea None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:26.506328 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe86e8-d638-4a87-a5cc-eb4a112c16ea None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:26.506598 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe86e8-d638-4a87-a5cc-eb4a112c16ea None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:26.507253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe86e8-d638-4a87-a5cc-eb4a112c16ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:26.507551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe86e8-d638-4a87-a5cc-eb4a112c16ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:26.508924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe86e8-d638-4a87-a5cc-eb4a112c16ea None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:26.516685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 633/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:09:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:26.523059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae4407-8c57-4521-b054-574ee00de4e5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:26.601241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:26.623558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae4407-8c57-4521-b054-574ee00de4e5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:26.657686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa9013-544a-462c-b995-44d70801f988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:26.658317 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa9013-544a-462c-b995-44d70801f988 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:26.658594 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa9013-544a-462c-b995-44d70801f988 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:26.658949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa9013-544a-462c-b995-44d70801f988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:26.669733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa9013-544a-462c-b995-44d70801f988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:26.671169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa9013-544a-462c-b995-44d70801f988 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-15aa9013-544a-462c-b995-44d70801f988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:26.686737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:26.687944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:26.689043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:26.689043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:26.689043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:26.689043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 618/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:26.694182 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe86e8-d638-4a87-a5cc-eb4a112c16ea None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:26.792867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe86e8-d638-4a87-a5cc-eb4a112c16ea None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:26.825944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f753d-c8e5-4e47-ab9a-ef3914a52a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:26.826543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f753d-c8e5-4e47-ab9a-ef3914a52a6d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:26.826822 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f753d-c8e5-4e47-ab9a-ef3914a52a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:26.827099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f753d-c8e5-4e47-ab9a-ef3914a52a6d None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:26.827736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f753d-c8e5-4e47-ab9a-ef3914a52a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:26.828033 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f753d-c8e5-4e47-ab9a-ef3914a52a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:26.829427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f753d-c8e5-4e47-ab9a-ef3914a52a6d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:26.841328 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 634/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:26.848592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa9013-544a-462c-b995-44d70801f988 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:26.947077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa9013-544a-462c-b995-44d70801f988 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:26.973719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:26.981350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7095c47-8de5-4b83-9040-742bd8e7d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:26.981994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095c47-8de5-4b83-9040-742bd8e7d3ff None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:26.982266 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095c47-8de5-4b83-9040-742bd8e7d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:26.982531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095c47-8de5-4b83-9040-742bd8e7d3ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:26.989718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7095c47-8de5-4b83-9040-742bd8e7d3ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:26.991241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7095c47-8de5-4b83-9040-742bd8e7d3ff None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-e7095c47-8de5-4b83-9040-742bd8e7d3ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:09:27.001811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:27.002951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:27.004853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:27.004853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:27.004853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:09:27.004853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:09:27.004853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:09:27.004853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:09:27.004853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:09:27.004853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:09:27.004853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:27.004853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:27.004853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 619/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:27.009316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f753d-c8e5-4e47-ab9a-ef3914a52a6d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:27.067409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:27.109713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f753d-c8e5-4e47-ab9a-ef3914a52a6d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:27.143200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9cf34-2e00-44ca-80a5-42e8d391c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:27.144553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9cf34-2e00-44ca-80a5-42e8d391c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:27.144833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9cf34-2e00-44ca-80a5-42e8d391c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:27.145131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9cf34-2e00-44ca-80a5-42e8d391c1d8 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:27.145872 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9cf34-2e00-44ca-80a5-42e8d391c1d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:27.146169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9cf34-2e00-44ca-80a5-42e8d391c1d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:27.147577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9cf34-2e00-44ca-80a5-42e8d391c1d8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:27.163846 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 635/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 17 16:09:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:27.169648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7095c47-8de5-4b83-9040-742bd8e7d3ff None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:27.269206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7095c47-8de5-4b83-9040-742bd8e7d3ff None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:27.302699 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1485b-043e-4672-bd90-e2b47f49ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:27.303282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1485b-043e-4672-bd90-e2b47f49ef40 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:27.303551 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1485b-043e-4672-bd90-e2b47f49ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:27.303813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1485b-043e-4672-bd90-e2b47f49ef40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:27.358597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:27.370524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1485b-043e-4672-bd90-e2b47f49ef40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:27.374001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1485b-043e-4672-bd90-e2b47f49ef40 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:27.471031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 620/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:09:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:09:27.477380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9cf34-2e00-44ca-80a5-42e8d391c1d8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:27.580352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9cf34-2e00-44ca-80a5-42e8d391c1d8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:27.593874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:27.615871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f5680-30d0-4587-b91d-ecc1eac585cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:27.616437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f5680-30d0-4587-b91d-ecc1eac585cd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:27.616713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f5680-30d0-4587-b91d-ecc1eac585cd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:27.616984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f5680-30d0-4587-b91d-ecc1eac585cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:27.626706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f5680-30d0-4587-b91d-ecc1eac585cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:27.628154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f5680-30d0-4587-b91d-ecc1eac585cd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-338f5680-30d0-4587-b91d-ecc1eac585cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:27.643207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:27.644311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:27.645628 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:27.645628 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:27.645628 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:27.645628 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 636/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:27.650302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1485b-043e-4672-bd90-e2b47f49ef40 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:27.736954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:27.750149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1485b-043e-4672-bd90-e2b47f49ef40 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:27.782650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d244f-f19e-463d-b3c2-a4f3521c3652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:27.783238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d244f-f19e-463d-b3c2-a4f3521c3652 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:27.783508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d244f-f19e-463d-b3c2-a4f3521c3652 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:27.783768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d244f-f19e-463d-b3c2-a4f3521c3652 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:27.784937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d244f-f19e-463d-b3c2-a4f3521c3652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:27.785227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d244f-f19e-463d-b3c2-a4f3521c3652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:27.786602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d244f-f19e-463d-b3c2-a4f3521c3652 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:27.797587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 621/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:27.803715 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f5680-30d0-4587-b91d-ecc1eac585cd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:27.903391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f5680-30d0-4587-b91d-ecc1eac585cd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:27.937462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835589b2-28f3-4a20-9b1c-ad0389061870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:27.938087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835589b2-28f3-4a20-9b1c-ad0389061870 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:27.938363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835589b2-28f3-4a20-9b1c-ad0389061870 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:27.938626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835589b2-28f3-4a20-9b1c-ad0389061870 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:27.945070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835589b2-28f3-4a20-9b1c-ad0389061870 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:27.951811 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835589b2-28f3-4a20-9b1c-ad0389061870 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-835589b2-28f3-4a20-9b1c-ad0389061870 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:09:27.958187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:27.959244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:27.960168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:09:27.960168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:09:27.960168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:09:27.960168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:09:27.960168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:09:27.960168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:09:27.960168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:27.960168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:27.960168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 637/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:09:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:27.965190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d244f-f19e-463d-b3c2-a4f3521c3652 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:28.065800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d244f-f19e-463d-b3c2-a4f3521c3652 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:28.099296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32ec21-b82a-4050-a33c-7ca65a893cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:28.099905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32ec21-b82a-4050-a33c-7ca65a893cdb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:28.100175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32ec21-b82a-4050-a33c-7ca65a893cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:28.100438 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32ec21-b82a-4050-a33c-7ca65a893cdb None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:28.101120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32ec21-b82a-4050-a33c-7ca65a893cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:28.101452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32ec21-b82a-4050-a33c-7ca65a893cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:28.102863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32ec21-b82a-4050-a33c-7ca65a893cdb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:28.114993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 622/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:09:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:28.121110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835589b2-28f3-4a20-9b1c-ad0389061870 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:28.147019 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:28.218638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835589b2-28f3-4a20-9b1c-ad0389061870 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:28.251981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3a384-052f-42a7-b345-44b42ed700bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:28.252615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3a384-052f-42a7-b345-44b42ed700bc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:28.252934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3a384-052f-42a7-b345-44b42ed700bc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:28.253219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3a384-052f-42a7-b345-44b42ed700bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:28.253967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3a384-052f-42a7-b345-44b42ed700bc None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=da5e1da2196b4ff399921809f40d3002) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:28.254271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3a384-052f-42a7-b345-44b42ed700bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:28.255698 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3a384-052f-42a7-b345-44b42ed700bc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:28.260964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 638/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:09:28 2022] GET /identity/v3/role_assignments?user.id=da5e1da2196b4ff399921809f40d3002&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=28beda93f70d4c549352145ddee01aac => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:30.133552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6251442-58a0-496c-812f-1242ac60063d None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:30.134107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6251442-58a0-496c-812f-1242ac60063d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:30.134107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6251442-58a0-496c-812f-1242ac60063d None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:30.135440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 623/1261] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:30.140664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd73ab-f774-4d0d-9d1c-00d80e91314d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:30.141072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd73ab-f774-4d0d-9d1c-00d80e91314d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:30.141207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd73ab-f774-4d0d-9d1c-00d80e91314d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:30.160999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1cdd73ab-f774-4d0d-9d1c-00d80e91314d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:30.162163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1cdd73ab-f774-4d0d-9d1c-00d80e91314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:30.228942 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 639/1262] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:09:30.493446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6251442-58a0-496c-812f-1242ac60063d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:30.504872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:30.593866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6251442-58a0-496c-812f-1242ac60063d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:30.628643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07054330-ab14-4290-9910-4f40324b4691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:30.629612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07054330-ab14-4290-9910-4f40324b4691 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:30.629894 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07054330-ab14-4290-9910-4f40324b4691 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:30.630167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07054330-ab14-4290-9910-4f40324b4691 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:30.640439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07054330-ab14-4290-9910-4f40324b4691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-07054330-ab14-4290-9910-4f40324b4691 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:09:30.645561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:30.646701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:30.647776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 624/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:09:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:09:30.652919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd73ab-f774-4d0d-9d1c-00d80e91314d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:30.671574 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:30.751703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd73ab-f774-4d0d-9d1c-00d80e91314d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:30.786288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93527a74-aed8-4db4-8230-8c8cd24546b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:30.786891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93527a74-aed8-4db4-8230-8c8cd24546b3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:30.787166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93527a74-aed8-4db4-8230-8c8cd24546b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:30.787434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93527a74-aed8-4db4-8230-8c8cd24546b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:30.788091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93527a74-aed8-4db4-8230-8c8cd24546b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:30.788389 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93527a74-aed8-4db4-8230-8c8cd24546b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:30.789788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93527a74-aed8-4db4-8230-8c8cd24546b3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:30.797607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 640/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:09:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:30.804199 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07054330-ab14-4290-9910-4f40324b4691 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:30.872713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:30.905734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07054330-ab14-4290-9910-4f40324b4691 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:30.942511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94033f6-0092-48e8-a080-2d10b045f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:30.943144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94033f6-0092-48e8-a080-2d10b045f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:30.943426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94033f6-0092-48e8-a080-2d10b045f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:30.943694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94033f6-0092-48e8-a080-2d10b045f6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:30.953636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94033f6-0092-48e8-a080-2d10b045f6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:30.955083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94033f6-0092-48e8-a080-2d10b045f6a6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-d94033f6-0092-48e8-a080-2d10b045f6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:30.971156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:30.976334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:30.977481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:30.977481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:30.977481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:30.977481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 625/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:30.979166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93527a74-aed8-4db4-8230-8c8cd24546b3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:31.062124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:31.080581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93527a74-aed8-4db4-8230-8c8cd24546b3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:31.114129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1af1b-b46c-4504-9a9b-dbbc84362d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:31.114735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1af1b-b46c-4504-9a9b-dbbc84362d03 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:31.115008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1af1b-b46c-4504-9a9b-dbbc84362d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:31.115277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1af1b-b46c-4504-9a9b-dbbc84362d03 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:31.115910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1af1b-b46c-4504-9a9b-dbbc84362d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:31.116209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1af1b-b46c-4504-9a9b-dbbc84362d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:31.117610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1af1b-b46c-4504-9a9b-dbbc84362d03 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:31.128815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 641/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:31.134648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94033f6-0092-48e8-a080-2d10b045f6a6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:31.234195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94033f6-0092-48e8-a080-2d10b045f6a6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:31.254297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:31.267764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4331ae-d5b9-4eb6-b413-1f2d79dab9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:31.268930 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4331ae-d5b9-4eb6-b413-1f2d79dab9af None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:31.269310 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4331ae-d5b9-4eb6-b413-1f2d79dab9af None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:31.269596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4331ae-d5b9-4eb6-b413-1f2d79dab9af None admin] PATH_INFO: `/v3/users/placement` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:31.277042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4331ae-d5b9-4eb6-b413-1f2d79dab9af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:31.278504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4331ae-d5b9-4eb6-b413-1f2d79dab9af None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-4e4331ae-d5b9-4eb6-b413-1f2d79dab9af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:09:31.289760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:31.290844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:31.291830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:31.291830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:31.291830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:09:31.291830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:09:31.291830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:09:31.291830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:09:31.291830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:09:31.291830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:09:31.291830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:31.291830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:31.291830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 626/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:09:31.296782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1af1b-b46c-4504-9a9b-dbbc84362d03 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:31.396262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1af1b-b46c-4504-9a9b-dbbc84362d03 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:31.430478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4b0a5-f25a-420f-b335-d18831636112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:31.431080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4b0a5-f25a-420f-b335-d18831636112 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:31.431356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4b0a5-f25a-420f-b335-d18831636112 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:31.431622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4b0a5-f25a-420f-b335-d18831636112 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:31.432607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4b0a5-f25a-420f-b335-d18831636112 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:31.432903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4b0a5-f25a-420f-b335-d18831636112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:31.434348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4b0a5-f25a-420f-b335-d18831636112 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:31.443412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:31.451207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 642/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 17 16:09:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:31.456976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4331ae-d5b9-4eb6-b413-1f2d79dab9af None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:31.560834 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4331ae-d5b9-4eb6-b413-1f2d79dab9af None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:31.593675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505029a1-3237-4676-969a-6e8324fb136b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:31.594303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505029a1-3237-4676-969a-6e8324fb136b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:31.594581 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505029a1-3237-4676-969a-6e8324fb136b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:31.594850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505029a1-3237-4676-969a-6e8324fb136b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:31.605904 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505029a1-3237-4676-969a-6e8324fb136b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:31.609652 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505029a1-3237-4676-969a-6e8324fb136b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-505029a1-3237-4676-969a-6e8324fb136b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:31.621744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:31.622922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:31.624210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:31.624210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:31.624210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:31.624210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 627/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:31.628799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4b0a5-f25a-420f-b335-d18831636112 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:31.726812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4b0a5-f25a-420f-b335-d18831636112 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:31.760232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d9d1a-c417-4e46-a917-16c662e16e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:31.760831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d9d1a-c417-4e46-a917-16c662e16e52 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:31.761122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d9d1a-c417-4e46-a917-16c662e16e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:31.761388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d9d1a-c417-4e46-a917-16c662e16e52 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:31.762024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d9d1a-c417-4e46-a917-16c662e16e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:31.762318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d9d1a-c417-4e46-a917-16c662e16e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:31.763685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d9d1a-c417-4e46-a917-16c662e16e52 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:31.775079 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 643/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:31.780852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505029a1-3237-4676-969a-6e8324fb136b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:31.812571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:31.881931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505029a1-3237-4676-969a-6e8324fb136b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:31.920582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d194b-9d23-4124-867b-80c9f3c7d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:31.921249 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d194b-9d23-4124-867b-80c9f3c7d8ce None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:31.921564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d194b-9d23-4124-867b-80c9f3c7d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:31.921838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d194b-9d23-4124-867b-80c9f3c7d8ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:31.928449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d194b-9d23-4124-867b-80c9f3c7d8ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:31.929928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d194b-9d23-4124-867b-80c9f3c7d8ce None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-5c3d194b-9d23-4124-867b-80c9f3c7d8ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:09:31.941184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:31.942276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:31.943403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:09:31.943403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:09:31.943403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:09:31.943403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:09:31.943403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:09:31.943403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:09:31.943403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:31.943403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:31.943403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 628/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:09:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:31.950025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d9d1a-c417-4e46-a917-16c662e16e52 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:32.013287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:32.054366 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d9d1a-c417-4e46-a917-16c662e16e52 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:32.088192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca2799-7876-48c0-8e56-b513a7c5e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:32.088806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca2799-7876-48c0-8e56-b513a7c5e20a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:32.089081 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca2799-7876-48c0-8e56-b513a7c5e20a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:32.089352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca2799-7876-48c0-8e56-b513a7c5e20a None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:32.090066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca2799-7876-48c0-8e56-b513a7c5e20a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:32.090366 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca2799-7876-48c0-8e56-b513a7c5e20a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:32.091891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca2799-7876-48c0-8e56-b513a7c5e20a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:32.104149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 644/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:09:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:32.110547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d194b-9d23-4124-867b-80c9f3c7d8ce None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:32.211151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:32.220307 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d194b-9d23-4124-867b-80c9f3c7d8ce None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:32.260471 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d8936-5ce2-41da-986f-f5b790b5921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:32.261418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8936-5ce2-41da-986f-f5b790b5921b None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:32.261703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8936-5ce2-41da-986f-f5b790b5921b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:32.261977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8936-5ce2-41da-986f-f5b790b5921b None admin] PATH_INFO: `/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/da5e1da2196b4ff399921809f40d3002/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:32.264449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d8936-5ce2-41da-986f-f5b790b5921b None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d22e410ba84b549429f1c9ae1390b0, user_id=da5e1da2196b4ff399921809f40d3002, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:32.265877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d8936-5ce2-41da-986f-f5b790b5921b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:32.347473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 629/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 17 16:09:32 2022] PUT /identity/v3/projects/f4d22e410ba84b549429f1c9ae1390b0/users/da5e1da2196b4ff399921809f40d3002/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:09:34.310028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316846a-3c95-429a-88cd-15c75ff1e918 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:34.310570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316846a-3c95-429a-88cd-15c75ff1e918 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:34.310570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316846a-3c95-429a-88cd-15c75ff1e918 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:34.311867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 645/1274] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:34.317443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964d0e4-2d84-49bb-aa0e-4433ac91359e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:34.322495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964d0e4-2d84-49bb-aa0e-4433ac91359e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:34.322495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964d0e4-2d84-49bb-aa0e-4433ac91359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:34.336667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5964d0e4-2d84-49bb-aa0e-4433ac91359e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:34.341442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5964d0e4-2d84-49bb-aa0e-4433ac91359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:34.408420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 630/1275] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:09:34.682354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316846a-3c95-429a-88cd-15c75ff1e918 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:34.794098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316846a-3c95-429a-88cd-15c75ff1e918 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:34.815657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:34.834051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f706fe9-c970-4e7f-af87-aeedf9e7e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:34.834698 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f706fe9-c970-4e7f-af87-aeedf9e7e41a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:34.834974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f706fe9-c970-4e7f-af87-aeedf9e7e41a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:34.835244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f706fe9-c970-4e7f-af87-aeedf9e7e41a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:34.846344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f706fe9-c970-4e7f-af87-aeedf9e7e41a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6f706fe9-c970-4e7f-af87-aeedf9e7e41a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:09:34.851744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:34.854089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:34.855097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 646/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 17 16:09:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:34.859472 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964d0e4-2d84-49bb-aa0e-4433ac91359e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:34.954000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:34.973083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964d0e4-2d84-49bb-aa0e-4433ac91359e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:35.015142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b1503-b19c-4849-b739-945c3815f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:35.015772 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1503-b19c-4849-b739-945c3815f873 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:35.016051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1503-b19c-4849-b739-945c3815f873 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:35.016325 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1503-b19c-4849-b739-945c3815f873 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:35.017007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b1503-b19c-4849-b739-945c3815f873 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:35.017311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b1503-b19c-4849-b739-945c3815f873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:35.018806 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b1503-b19c-4849-b739-945c3815f873 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:35.028375 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 631/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 17 16:09:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:35.034828 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f706fe9-c970-4e7f-af87-aeedf9e7e41a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:35.142469 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f706fe9-c970-4e7f-af87-aeedf9e7e41a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:35.182065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d0502-d17c-45b3-9885-26fba730cd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:35.182700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d0502-d17c-45b3-9885-26fba730cd89 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:35.182996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d0502-d17c-45b3-9885-26fba730cd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:35.183245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d0502-d17c-45b3-9885-26fba730cd89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:35.193769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d0502-d17c-45b3-9885-26fba730cd89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:35.195264 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d0502-d17c-45b3-9885-26fba730cd89 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-258d0502-d17c-45b3-9885-26fba730cd89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:35.210078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:35.211236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:35.212355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:35.212355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:35.212355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:35.212355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 647/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:35.217684 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b1503-b19c-4849-b739-945c3815f873 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:35.319226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b1503-b19c-4849-b739-945c3815f873 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:35.352676 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae35849-6667-40b5-8394-4b304f979bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:35.353274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae35849-6667-40b5-8394-4b304f979bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:35.353571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae35849-6667-40b5-8394-4b304f979bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:35.353835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae35849-6667-40b5-8394-4b304f979bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:35.354464 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae35849-6667-40b5-8394-4b304f979bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:35.354761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae35849-6667-40b5-8394-4b304f979bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:35.356236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae35849-6667-40b5-8394-4b304f979bf2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:35.368299 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 632/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:35.374083 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d0502-d17c-45b3-9885-26fba730cd89 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:35.403934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:35.472876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d0502-d17c-45b3-9885-26fba730cd89 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:35.505179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d1c1-dab0-48c8-bfb4-def8c93821fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:35.509820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d1c1-dab0-48c8-bfb4-def8c93821fd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:35.509820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d1c1-dab0-48c8-bfb4-def8c93821fd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:35.509820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d1c1-dab0-48c8-bfb4-def8c93821fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:35.512972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d1c1-dab0-48c8-bfb4-def8c93821fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:35.514425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d1c1-dab0-48c8-bfb4-def8c93821fd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-1fc9d1c1-dab0-48c8-bfb4-def8c93821fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:09:35.526952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:35.528110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:35.529502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:35.529502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:35.529502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:09:35.529502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:09:35.529502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:09:35.529502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:09:35.529502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:09:35.529502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:09:35.529502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:09:35.529502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:35.529502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 648/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:35.534490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae35849-6667-40b5-8394-4b304f979bf2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:35.538285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:35.640445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae35849-6667-40b5-8394-4b304f979bf2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:35.675547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed635a-1b52-40ca-90e5-30d82d079612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:35.676152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed635a-1b52-40ca-90e5-30d82d079612 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:35.676424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed635a-1b52-40ca-90e5-30d82d079612 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:35.676691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed635a-1b52-40ca-90e5-30d82d079612 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:35.677484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed635a-1b52-40ca-90e5-30d82d079612 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:35.680821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed635a-1b52-40ca-90e5-30d82d079612 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:35.680821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed635a-1b52-40ca-90e5-30d82d079612 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:35.696662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 633/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 17 16:09:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:35.702429 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d1c1-dab0-48c8-bfb4-def8c93821fd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:35.792552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:35.801829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d1c1-dab0-48c8-bfb4-def8c93821fd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:35.836678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5e021-3b24-4514-9474-c5a2ec77e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:35.837288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5e021-3b24-4514-9474-c5a2ec77e1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:35.837600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5e021-3b24-4514-9474-c5a2ec77e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:35.837941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5e021-3b24-4514-9474-c5a2ec77e1a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:35.906035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5e021-3b24-4514-9474-c5a2ec77e1a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:35.907504 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5e021-3b24-4514-9474-c5a2ec77e1a3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:35.998259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:36.008377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 649/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 17 16:09:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:09:36.014394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed635a-1b52-40ca-90e5-30d82d079612 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:36.076378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:36.115181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed635a-1b52-40ca-90e5-30d82d079612 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:36.147631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a20817-50c5-4963-a38a-76a187b907c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:36.148252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a20817-50c5-4963-a38a-76a187b907c2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:36.148526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a20817-50c5-4963-a38a-76a187b907c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:36.148795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a20817-50c5-4963-a38a-76a187b907c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:36.159782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a20817-50c5-4963-a38a-76a187b907c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:36.161215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a20817-50c5-4963-a38a-76a187b907c2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f0a20817-50c5-4963-a38a-76a187b907c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:09:36.175606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:36.180580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:09:36.181990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:09:36.181990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:09:36.181990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:36.181990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 634/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:36.182931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5e021-3b24-4514-9474-c5a2ec77e1a3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:36.280092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5e021-3b24-4514-9474-c5a2ec77e1a3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:36.313487 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165473-cf38-417d-9094-804941f318c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:36.314080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165473-cf38-417d-9094-804941f318c4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:36.314354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165473-cf38-417d-9094-804941f318c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:36.314621 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165473-cf38-417d-9094-804941f318c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:36.315319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165473-cf38-417d-9094-804941f318c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:36.315656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165473-cf38-417d-9094-804941f318c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:36.317020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165473-cf38-417d-9094-804941f318c4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:36.328102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 650/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 17 16:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:36.334390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a20817-50c5-4963-a38a-76a187b907c2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:36.434750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a20817-50c5-4963-a38a-76a187b907c2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:36.448222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:36.468011 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58311a43-8df3-45e8-809a-29c0d302461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:36.468635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311a43-8df3-45e8-809a-29c0d302461d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:36.468908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311a43-8df3-45e8-809a-29c0d302461d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:36.469176 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58311a43-8df3-45e8-809a-29c0d302461d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:36.476291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58311a43-8df3-45e8-809a-29c0d302461d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:36.477752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58311a43-8df3-45e8-809a-29c0d302461d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-58311a43-8df3-45e8-809a-29c0d302461d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:09:36.489166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:36.490269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:36.491179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:09:36.491179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:09:36.491179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:09:36.491179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:09:36.491179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:09:36.491179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:09:36.491179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:09:36.491179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Aug 17 16:09:36.491179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 635/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 17 16:09:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:36.496176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165473-cf38-417d-9094-804941f318c4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:36.546679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:36.595306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165473-cf38-417d-9094-804941f318c4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:36.628799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373ebf9-5d0e-49a5-820d-94e76045e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:36.629413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373ebf9-5d0e-49a5-820d-94e76045e3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:36.629692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373ebf9-5d0e-49a5-820d-94e76045e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:36.629957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373ebf9-5d0e-49a5-820d-94e76045e3d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:36.630623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373ebf9-5d0e-49a5-820d-94e76045e3d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:36.630917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373ebf9-5d0e-49a5-820d-94e76045e3d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:36.632317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373ebf9-5d0e-49a5-820d-94e76045e3d7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:36.644573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 651/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 17 16:09:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:36.650800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58311a43-8df3-45e8-809a-29c0d302461d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:36.749215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58311a43-8df3-45e8-809a-29c0d302461d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:36.782877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec02a4-666f-46df-9eae-7c0af65bed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:36.783676 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec02a4-666f-46df-9eae-7c0af65bed8e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:36.783971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec02a4-666f-46df-9eae-7c0af65bed8e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:36.784335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec02a4-666f-46df-9eae-7c0af65bed8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:36.785046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec02a4-666f-46df-9eae-7c0af65bed8e None admin] RBAC: Adding query filter params (role.id=28beda93f70d4c549352145ddee01aac, scope.project.id=f4d22e410ba84b549429f1c9ae1390b0, user.id=da5e1da2196b4ff399921809f40d3002) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:36.785346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec02a4-666f-46df-9eae-7c0af65bed8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:36.789607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec02a4-666f-46df-9eae-7c0af65bed8e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:36.792434 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 636/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 17 16:09:36 2022] GET /identity/v3/role_assignments?user.id=da5e1da2196b4ff399921809f40d3002&scope.project.id=f4d22e410ba84b549429f1c9ae1390b0&role.id=28beda93f70d4c549352145ddee01aac => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:38.734435 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3aae67-97f2-48d4-8025-bb63112cd0ea None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:38.734995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3aae67-97f2-48d4-8025-bb63112cd0ea None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:38.734995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3aae67-97f2-48d4-8025-bb63112cd0ea None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:38.736287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 652/1288] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:09:38.742039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1122-e936-4da1-bfa6-b9725b175fc5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:38.742445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1122-e936-4da1-bfa6-b9725b175fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:38.742931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1122-e936-4da1-bfa6-b9725b175fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:38.761216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-25fa1122-e936-4da1-bfa6-b9725b175fc5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:38.762419 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-25fa1122-e936-4da1-bfa6-b9725b175fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:38.791773 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:38.827982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 637/1289] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:09:39.101118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3aae67-97f2-48d4-8025-bb63112cd0ea None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:39.201633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3aae67-97f2-48d4-8025-bb63112cd0ea None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:39.212686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:39.235589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7ebb4-9628-461c-bf1a-bee7a4b09283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:39.236204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7ebb4-9628-461c-bf1a-bee7a4b09283 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:39.236669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7ebb4-9628-461c-bf1a-bee7a4b09283 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:39.236990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7ebb4-9628-461c-bf1a-bee7a4b09283 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:39.237698 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7ebb4-9628-461c-bf1a-bee7a4b09283 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:39.239064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7ebb4-9628-461c-bf1a-bee7a4b09283 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-bec7ebb4-9628-461c-bf1a-bee7a4b09283 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:39.247626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:39.248800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:39.249728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 653/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 17 16:09:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:39.255082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1122-e936-4da1-bfa6-b9725b175fc5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:39.353732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1122-e936-4da1-bfa6-b9725b175fc5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:39.386609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc388-757f-4873-9ab1-6ee0cfc258a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:39.387208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc388-757f-4873-9ab1-6ee0cfc258a8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:39.387485 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc388-757f-4873-9ab1-6ee0cfc258a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:39.387753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc388-757f-4873-9ab1-6ee0cfc258a8 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:39.388380 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc388-757f-4873-9ab1-6ee0cfc258a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:39.388674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc388-757f-4873-9ab1-6ee0cfc258a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:39.390197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc388-757f-4873-9ab1-6ee0cfc258a8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:39.395483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 638/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 17 16:09:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:39.401526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7ebb4-9628-461c-bf1a-bee7a4b09283 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:39.498197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7ebb4-9628-461c-bf1a-bee7a4b09283 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:39.530241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38240f19-a39a-4f86-8cc6-41a6748d552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:39.530831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240f19-a39a-4f86-8cc6-41a6748d552e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:39.531102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240f19-a39a-4f86-8cc6-41a6748d552e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:39.531369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240f19-a39a-4f86-8cc6-41a6748d552e None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:39.531991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38240f19-a39a-4f86-8cc6-41a6748d552e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:39.532288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38240f19-a39a-4f86-8cc6-41a6748d552e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:39.534423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38240f19-a39a-4f86-8cc6-41a6748d552e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:39.538662 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 654/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 17 16:09:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:09:41.437783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ab138-fe9e-44ca-8a0b-8a5efa33034d None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:41.438342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ab138-fe9e-44ca-8a0b-8a5efa33034d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:41.438342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ab138-fe9e-44ca-8a0b-8a5efa33034d None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:41.439693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 639/1293] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:41.444875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6231-aecc-4204-ad61-508991be5f03 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:41.448578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6231-aecc-4204-ad61-508991be5f03 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:41.448578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6231-aecc-4204-ad61-508991be5f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:41.463836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-296a6231-aecc-4204-ad61-508991be5f03 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:41.465020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-296a6231-aecc-4204-ad61-508991be5f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:41.494502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:41.530304 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 655/1294] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:09:41.807595 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ab138-fe9e-44ca-8a0b-8a5efa33034d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:41.839918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:41.917028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ab138-fe9e-44ca-8a0b-8a5efa33034d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:41.951245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d0600-170f-4dcd-9ca6-ae828ad2dfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:41.951877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d0600-170f-4dcd-9ca6-ae828ad2dfa7 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:41.952153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d0600-170f-4dcd-9ca6-ae828ad2dfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:41.952421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d0600-170f-4dcd-9ca6-ae828ad2dfa7 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:41.953063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d0600-170f-4dcd-9ca6-ae828ad2dfa7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:41.954528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d0600-170f-4dcd-9ca6-ae828ad2dfa7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:42.048070 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 640/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 17 16:09:41 2022] POST /identity/v3/services => generated 246 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:09:43.952124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5fe9f-cef2-4e20-9227-f990e3bf9d5e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:43.952616 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5fe9f-cef2-4e20-9227-f990e3bf9d5e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:43.952731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5fe9f-cef2-4e20-9227-f990e3bf9d5e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:43.954043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 656/1296] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:43.960298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05f0b0-60c7-448c-9789-0d11f98de8fb None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:43.960746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05f0b0-60c7-448c-9789-0d11f98de8fb None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:43.960838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05f0b0-60c7-448c-9789-0d11f98de8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:43.979103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6e05f0b0-60c7-448c-9789-0d11f98de8fb None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:43.980278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6e05f0b0-60c7-448c-9789-0d11f98de8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:44.052787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 641/1297] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:09:44.323404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5fe9f-cef2-4e20-9227-f990e3bf9d5e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:44.425182 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5fe9f-cef2-4e20-9227-f990e3bf9d5e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:44.458462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945d608-df54-484c-bbd1-8f051b9ba27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:44.459087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d608-df54-484c-bbd1-8f051b9ba27f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:44.459409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d608-df54-484c-bbd1-8f051b9ba27f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:44.459682 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d608-df54-484c-bbd1-8f051b9ba27f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:44.460255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945d608-df54-484c-bbd1-8f051b9ba27f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:44.461657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945d608-df54-484c-bbd1-8f051b9ba27f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7945d608-df54-484c-bbd1-8f051b9ba27f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:44.470170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:44.477677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:44.478762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 657/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 17 16:09:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:44.479584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05f0b0-60c7-448c-9789-0d11f98de8fb None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:44.496275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:44.574238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05f0b0-60c7-448c-9789-0d11f98de8fb None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:44.607151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baccbff-8afb-4f1a-8aa6-e878dead418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:44.607744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baccbff-8afb-4f1a-8aa6-e878dead418c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:44.608015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baccbff-8afb-4f1a-8aa6-e878dead418c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:44.608280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baccbff-8afb-4f1a-8aa6-e878dead418c None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:44.608891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baccbff-8afb-4f1a-8aa6-e878dead418c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:44.609183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baccbff-8afb-4f1a-8aa6-e878dead418c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:44.610569 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baccbff-8afb-4f1a-8aa6-e878dead418c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:44.616060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 642/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 17 16:09:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:44.622176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945d608-df54-484c-bbd1-8f051b9ba27f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:44.653161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:44.720271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945d608-df54-484c-bbd1-8f051b9ba27f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:44.753004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66bafc-e856-4adb-a55e-5d1c7d90b520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:44.753649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66bafc-e856-4adb-a55e-5d1c7d90b520 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:44.753924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66bafc-e856-4adb-a55e-5d1c7d90b520 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:44.754191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66bafc-e856-4adb-a55e-5d1c7d90b520 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:44.754874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66bafc-e856-4adb-a55e-5d1c7d90b520 None admin] RBAC: Adding query filter params (interface=public, service_id=8aed4ae41b884f038ca54548b6a91522, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:44.755172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66bafc-e856-4adb-a55e-5d1c7d90b520 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:44.756534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66bafc-e856-4adb-a55e-5d1c7d90b520 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:44.761494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 658/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 17 16:09:44 2022] GET /identity/v3/endpoints?service_id=8aed4ae41b884f038ca54548b6a91522&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:44.767150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baccbff-8afb-4f1a-8aa6-e878dead418c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:44.848724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:44.865913 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baccbff-8afb-4f1a-8aa6-e878dead418c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:44.899546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195c9c3-4b4f-44bf-b014-701f652a762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:44.900149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195c9c3-4b4f-44bf-b014-701f652a762e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:44.900420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195c9c3-4b4f-44bf-b014-701f652a762e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:44.900681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195c9c3-4b4f-44bf-b014-701f652a762e None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:44.901270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195c9c3-4b4f-44bf-b014-701f652a762e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:44.902660 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195c9c3-4b4f-44bf-b014-701f652a762e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:44.910085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 643/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 17 16:09:44 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:09:46.792110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc400fe-c814-477f-8d8e-c45abcacc3e0 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:46.792637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc400fe-c814-477f-8d8e-c45abcacc3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:46.792637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc400fe-c814-477f-8d8e-c45abcacc3e0 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:46.794054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 659/1302] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:46.799549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20254-1941-4210-a053-f180788d1e68 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:46.799940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20254-1941-4210-a053-f180788d1e68 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:46.800122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20254-1941-4210-a053-f180788d1e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:46.818397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3ba20254-1941-4210-a053-f180788d1e68 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:46.819578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3ba20254-1941-4210-a053-f180788d1e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:46.888580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 644/1303] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:09:47.160289 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc400fe-c814-477f-8d8e-c45abcacc3e0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:47.254322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:47.260871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc400fe-c814-477f-8d8e-c45abcacc3e0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:47.293916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34544560-e53e-4f02-b32f-65a8dba8e655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:47.294535 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34544560-e53e-4f02-b32f-65a8dba8e655 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:47.294810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34544560-e53e-4f02-b32f-65a8dba8e655 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:47.295082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34544560-e53e-4f02-b32f-65a8dba8e655 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:47.295651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34544560-e53e-4f02-b32f-65a8dba8e655 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:47.297003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34544560-e53e-4f02-b32f-65a8dba8e655 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-34544560-e53e-4f02-b32f-65a8dba8e655 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:09:47.306339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:09:47.307512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Aug 17 16:09:47.308491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 660/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 17 16:09:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:09:47.313902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba20254-1941-4210-a053-f180788d1e68 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:47.389189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:47.411784 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba20254-1941-4210-a053-f180788d1e68 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:47.446551 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261d06a-4917-460d-b567-e08492ee2e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:47.447162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261d06a-4917-460d-b567-e08492ee2e3c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:47.447452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261d06a-4917-460d-b567-e08492ee2e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:47.447700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261d06a-4917-460d-b567-e08492ee2e3c None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:47.448316 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261d06a-4917-460d-b567-e08492ee2e3c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:09:47.448609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261d06a-4917-460d-b567-e08492ee2e3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:47.449991 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261d06a-4917-460d-b567-e08492ee2e3c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:47.455108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 645/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 17 16:09:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:09:47.460845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34544560-e53e-4f02-b32f-65a8dba8e655 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:47.558622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34544560-e53e-4f02-b32f-65a8dba8e655 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:47.591712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003bd3d-6864-4e63-a95c-4844d9846604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:47.592330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003bd3d-6864-4e63-a95c-4844d9846604 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:47.592603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003bd3d-6864-4e63-a95c-4844d9846604 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:47.592869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003bd3d-6864-4e63-a95c-4844d9846604 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:47.593546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003bd3d-6864-4e63-a95c-4844d9846604 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:47.594960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003bd3d-6864-4e63-a95c-4844d9846604 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:47.688206 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 661/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:09:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:09:57.451970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=30 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:57.683506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:25.414750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b34da-125b-4185-9cfc-9fae572de7c7 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.415331 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b34da-125b-4185-9cfc-9fae572de7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.415331 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b34da-125b-4185-9cfc-9fae572de7c7 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.417124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 646/1307] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:25.422829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7b1fb-f801-4930-9205-0da70093d66a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.423817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7b1fb-f801-4930-9205-0da70093d66a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.424448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7b1fb-f801-4930-9205-0da70093d66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.563061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-99f7b1fb-f801-4930-9205-0da70093d66a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:25.564394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-99f7b1fb-f801-4930-9205-0da70093d66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:25.761913 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 662/1308] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:26.122142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73798b5-753a-4da9-ac78-63cc6f207710 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:26.122638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73798b5-753a-4da9-ac78-63cc6f207710 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:26.123120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73798b5-753a-4da9-ac78-63cc6f207710 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:26.124688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 647/1309] 10.222.0.40 () {54 vars in 965 bytes} [Wed Aug 17 16:15:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:26.131123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61e423-dca5-4387-b02b-a3ff9387ff7b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:26.131638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61e423-dca5-4387-b02b-a3ff9387ff7b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:26.132135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61e423-dca5-4387-b02b-a3ff9387ff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:26.314088 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8c61e423-dca5-4387-b02b-a3ff9387ff7b None None] MFA Rules not processed for user `4ad54a22e6e747d9887c82bb62a923da`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:26.317204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8c61e423-dca5-4387-b02b-a3ff9387ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:26.372985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:26.476355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 663/1310] 10.222.0.40 () {58 vars in 1062 bytes} [Wed Aug 17 16:15:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:26.493895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73798b5-753a-4da9-ac78-63cc6f207710 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:26.496923 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b73798b5-753a-4da9-ac78-63cc6f207710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:26.635075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73798b5-753a-4da9-ac78-63cc6f207710 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:26.719565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c2afb-e5e9-478d-9592-843f6ac91f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:26.720289 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c2afb-e5e9-478d-9592-843f6ac91f17 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:26.720622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c2afb-e5e9-478d-9592-843f6ac91f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:26.720953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c2afb-e5e9-478d-9592-843f6ac91f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:26.722639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-593c2afb-e5e9-478d-9592-843f6ac91f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:26.781982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:26.844646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c2afb-e5e9-478d-9592-843f6ac91f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:26.846227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c2afb-e5e9-478d-9592-843f6ac91f17 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:26.867148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 648/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:29.106965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada131a-44d7-4a0d-8912-8732c3884563 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:29.107472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada131a-44d7-4a0d-8912-8732c3884563 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:29.107591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada131a-44d7-4a0d-8912-8732c3884563 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:29.108905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 664/1312] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:29.114151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6646e4e-9ee2-44ae-83ab-5b3de165fff5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:29.114555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6646e4e-9ee2-44ae-83ab-5b3de165fff5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:29.114684 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6646e4e-9ee2-44ae-83ab-5b3de165fff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:29.199505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d6646e4e-9ee2-44ae-83ab-5b3de165fff5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:29.200638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d6646e4e-9ee2-44ae-83ab-5b3de165fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:29.300044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 649/1313] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:29.577930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada131a-44d7-4a0d-8912-8732c3884563 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:29.579457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3ada131a-44d7-4a0d-8912-8732c3884563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:29.683738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada131a-44d7-4a0d-8912-8732c3884563 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:29.754006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:29.756521 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6720e0-5f70-4390-bcb2-092cc6e37e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:29.757120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6720e0-5f70-4390-bcb2-092cc6e37e4f service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:29.757423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6720e0-5f70-4390-bcb2-092cc6e37e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:29.757694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6720e0-5f70-4390-bcb2-092cc6e37e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:29.759272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bc6720e0-5f70-4390-bcb2-092cc6e37e4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:29.866198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6720e0-5f70-4390-bcb2-092cc6e37e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:29.867619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6720e0-5f70-4390-bcb2-092cc6e37e4f service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:29.886570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 665/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:15:32.207036 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677445f7-5a65-4198-b97d-7d04398e7fce None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:32.207567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677445f7-5a65-4198-b97d-7d04398e7fce None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:32.207567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677445f7-5a65-4198-b97d-7d04398e7fce None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:32.208830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 650/1315] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:32.213916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debb1e6-df28-4934-afdb-f02ec56196d3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:32.214305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debb1e6-df28-4934-afdb-f02ec56196d3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:32.214502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debb1e6-df28-4934-afdb-f02ec56196d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:32.279050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6debb1e6-df28-4934-afdb-f02ec56196d3 None None] MFA Rules not processed for user `7d8d47bc48854f978d82fae1c6ad4c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:32.280275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6debb1e6-df28-4934-afdb-f02ec56196d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:32.332162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:32.376514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 666/1316] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:15:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:32.660948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677445f7-5a65-4198-b97d-7d04398e7fce None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:32.662522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-677445f7-5a65-4198-b97d-7d04398e7fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:32.673042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:32.769718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677445f7-5a65-4198-b97d-7d04398e7fce None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:32.843467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2af950-a6c2-445c-8e77-f47f4ca2f67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:32.844076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2af950-a6c2-445c-8e77-f47f4ca2f67f service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:32.844076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2af950-a6c2-445c-8e77-f47f4ca2f67f service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:32.844076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2af950-a6c2-445c-8e77-f47f4ca2f67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:32.844076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2c2af950-a6c2-445c-8e77-f47f4ca2f67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:32.909514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:32.956544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2af950-a6c2-445c-8e77-f47f4ca2f67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:32.958021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2af950-a6c2-445c-8e77-f47f4ca2f67f service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:32.975775 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 651/1317] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:35.692242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0dca1-ff7f-451f-bc2c-535f65954bce None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.692837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0dca1-ff7f-451f-bc2c-535f65954bce None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.692837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0dca1-ff7f-451f-bc2c-535f65954bce None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.694137 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 667/1318] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:35.699360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1ad4-3fd8-45d9-8b50-6356ca7e2ff2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.699807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1ad4-3fd8-45d9-8b50-6356ca7e2ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.699923 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1ad4-3fd8-45d9-8b50-6356ca7e2ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.763895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8f1e1ad4-3fd8-45d9-8b50-6356ca7e2ff2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:35.765095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8f1e1ad4-3fd8-45d9-8b50-6356ca7e2ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:35.858037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 652/1319] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:15:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:36.140269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0dca1-ff7f-451f-bc2c-535f65954bce None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:36.141835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e6a0dca1-ff7f-451f-bc2c-535f65954bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:36.241188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0dca1-ff7f-451f-bc2c-535f65954bce None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:36.311830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4506f-f453-4e25-bce2-886ec340fa4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:36.312417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4506f-f453-4e25-bce2-886ec340fa4e service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:36.312687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4506f-f453-4e25-bce2-886ec340fa4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:36.312951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4506f-f453-4e25-bce2-886ec340fa4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:36.314530 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7bc4506f-f453-4e25-bce2-886ec340fa4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:36.321636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:36.422177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4506f-f453-4e25-bce2-886ec340fa4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:36.423522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4506f-f453-4e25-bce2-886ec340fa4e service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:36.440969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 668/1320] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:39.389657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456a1c8-44c1-4eae-869e-b36e505d997d None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.390236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456a1c8-44c1-4eae-869e-b36e505d997d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.390236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456a1c8-44c1-4eae-869e-b36e505d997d None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:39.391550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 653/1321] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:39.396632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16988503-ddb9-4619-a9e4-535f38a7edde None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.397082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16988503-ddb9-4619-a9e4-535f38a7edde None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.397337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16988503-ddb9-4619-a9e4-535f38a7edde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:39.464143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-16988503-ddb9-4619-a9e4-535f38a7edde None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:39.465332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16988503-ddb9-4619-a9e4-535f38a7edde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:39.524462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:39.564812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 669/1322] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:39.862514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e95842-541b-42de-8a9d-aa7898e91708 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.862881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e95842-541b-42de-8a9d-aa7898e91708 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.863219 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e95842-541b-42de-8a9d-aa7898e91708 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:39.864634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 654/1323] 10.222.0.40 () {54 vars in 965 bytes} [Wed Aug 17 16:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:39.870728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ca11f-6e01-405b-a8db-4be75b1acc32 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.871004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ca11f-6e01-405b-a8db-4be75b1acc32 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.871275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ca11f-6e01-405b-a8db-4be75b1acc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:39.951836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-833ca11f-6e01-405b-a8db-4be75b1acc32 None None] MFA Rules not processed for user `4ad54a22e6e747d9887c82bb62a923da`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:39.953061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-833ca11f-6e01-405b-a8db-4be75b1acc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:40.030378 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 670/1324] 10.222.0.40 () {58 vars in 1062 bytes} [Wed Aug 17 16:15:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:40.039339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e95842-541b-42de-8a9d-aa7898e91708 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:40.041498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e1e95842-541b-42de-8a9d-aa7898e91708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:40.064216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:40.154809 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e95842-541b-42de-8a9d-aa7898e91708 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:40.247946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b08a5b-6a44-4a7e-bf75-abe48b1ef8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:40.248599 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b08a5b-6a44-4a7e-bf75-abe48b1ef8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:40.248875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b08a5b-6a44-4a7e-bf75-abe48b1ef8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:40.249142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b08a5b-6a44-4a7e-bf75-abe48b1ef8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:40.250899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e8b08a5b-6a44-4a7e-bf75-abe48b1ef8e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:40.327785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:40.374855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b08a5b-6a44-4a7e-bf75-abe48b1ef8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:40.376409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b08a5b-6a44-4a7e-bf75-abe48b1ef8e8 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:40.399620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 655/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:42.628747 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb855b-7b4a-40d1-8d43-d37ea0a5717e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:42.629325 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb855b-7b4a-40d1-8d43-d37ea0a5717e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:42.629325 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb855b-7b4a-40d1-8d43-d37ea0a5717e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:42.630798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 671/1326] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:42.637354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b98d4-feb7-4fa7-851d-326ec4866481 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:42.637958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b98d4-feb7-4fa7-851d-326ec4866481 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:42.638060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b98d4-feb7-4fa7-851d-326ec4866481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:42.708892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ca2b98d4-feb7-4fa7-851d-326ec4866481 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:42.710123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ca2b98d4-feb7-4fa7-851d-326ec4866481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:42.809879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 656/1327] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:43.096006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb855b-7b4a-40d1-8d43-d37ea0a5717e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:43.097581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3cbb855b-7b4a-40d1-8d43-d37ea0a5717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:43.158001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:43.202984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb855b-7b4a-40d1-8d43-d37ea0a5717e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:43.274891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c668b50-2da1-4b77-90d8-09acbbdc927b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:43.276134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c668b50-2da1-4b77-90d8-09acbbdc927b service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:43.276411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c668b50-2da1-4b77-90d8-09acbbdc927b service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:43.276677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c668b50-2da1-4b77-90d8-09acbbdc927b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:43.278278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8c668b50-2da1-4b77-90d8-09acbbdc927b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:43.388017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:43.390335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c668b50-2da1-4b77-90d8-09acbbdc927b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:43.391764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c668b50-2da1-4b77-90d8-09acbbdc927b service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:43.410382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 672/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:45.366353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45d84a-bdd1-4e76-a651-83c67d3d8b58 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:45.366892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45d84a-bdd1-4e76-a651-83c67d3d8b58 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:45.366892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45d84a-bdd1-4e76-a651-83c67d3d8b58 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:45.368263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 657/1329] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:45.373726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8cc51-c1db-4da7-8869-e877c9738ff1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:45.374157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8cc51-c1db-4da7-8869-e877c9738ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:45.374355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8cc51-c1db-4da7-8869-e877c9738ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:45.457716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-84b8cc51-c1db-4da7-8869-e877c9738ff1 None None] MFA Rules not processed for user `7d8d47bc48854f978d82fae1c6ad4c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:45.458924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-84b8cc51-c1db-4da7-8869-e877c9738ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:45.564322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 673/1330] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:15:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:45.845067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45d84a-bdd1-4e76-a651-83c67d3d8b58 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:45.846653 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5a45d84a-bdd1-4e76-a651-83c67d3d8b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:45.878531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:45.951663 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45d84a-bdd1-4e76-a651-83c67d3d8b58 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:46.028136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ded696-ea0a-46f0-ac29-5661f7a4af45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:46.028748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ded696-ea0a-46f0-ac29-5661f7a4af45 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:46.029019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ded696-ea0a-46f0-ac29-5661f7a4af45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:46.029288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ded696-ea0a-46f0-ac29-5661f7a4af45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:46.030922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d6ded696-ea0a-46f0-ac29-5661f7a4af45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:46.116015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:46.149771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ded696-ea0a-46f0-ac29-5661f7a4af45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:46.151301 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ded696-ea0a-46f0-ac29-5661f7a4af45 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:46.171322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 658/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:48.694688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0517-9b6b-47ad-95ce-8fd58ac2598f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:48.695258 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0517-9b6b-47ad-95ce-8fd58ac2598f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:48.695258 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0517-9b6b-47ad-95ce-8fd58ac2598f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:48.696588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 674/1332] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:48.702207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529201-0621-4788-81e0-c8ed04e04324 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:48.702662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529201-0621-4788-81e0-c8ed04e04324 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:48.702776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529201-0621-4788-81e0-c8ed04e04324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:48.767960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-bd529201-0621-4788-81e0-c8ed04e04324 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:48.769184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bd529201-0621-4788-81e0-c8ed04e04324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:48.864218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 659/1333] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:49.145648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0517-9b6b-47ad-95ce-8fd58ac2598f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:49.147193 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-674a0517-9b6b-47ad-95ce-8fd58ac2598f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:49.215468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:49.248668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0517-9b6b-47ad-95ce-8fd58ac2598f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:49.321114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a498d09-efbe-40a1-a496-65064e41274e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:49.321777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a498d09-efbe-40a1-a496-65064e41274e service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:49.322055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a498d09-efbe-40a1-a496-65064e41274e service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:49.322302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a498d09-efbe-40a1-a496-65064e41274e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:49.323882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1a498d09-efbe-40a1-a496-65064e41274e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:49.429958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a498d09-efbe-40a1-a496-65064e41274e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:49.431720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a498d09-efbe-40a1-a496-65064e41274e service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:49.441666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:49.450301 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 675/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:51.390290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff537-c4cd-47ff-b9e2-740e7a8aa557 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:51.390834 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff537-c4cd-47ff-b9e2-740e7a8aa557 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:51.390834 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff537-c4cd-47ff-b9e2-740e7a8aa557 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:51.392169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 660/1335] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:51.397482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717fdd7-f5f4-4923-be2a-ed2be3c1d388 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:51.397908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717fdd7-f5f4-4923-be2a-ed2be3c1d388 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:51.398015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717fdd7-f5f4-4923-be2a-ed2be3c1d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:51.467480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a717fdd7-f5f4-4923-be2a-ed2be3c1d388 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:51.468477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a717fdd7-f5f4-4923-be2a-ed2be3c1d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:51.565144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 676/1336] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:51.852570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ff537-c4cd-47ff-b9e2-740e7a8aa557 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:51.854777 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-617ff537-c4cd-47ff-b9e2-740e7a8aa557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:51.903484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:51.972946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ff537-c4cd-47ff-b9e2-740e7a8aa557 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:52.047063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82533a-ab09-4019-a1ad-a8355b492ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:52.047675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82533a-ab09-4019-a1ad-a8355b492ffe service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:52.047948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82533a-ab09-4019-a1ad-a8355b492ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:52.048208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82533a-ab09-4019-a1ad-a8355b492ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:52.049820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8a82533a-ab09-4019-a1ad-a8355b492ffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:52.133385 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:52.158088 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82533a-ab09-4019-a1ad-a8355b492ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:52.159618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82533a-ab09-4019-a1ad-a8355b492ffe service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:52.178034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 661/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:54.739676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4670b-1d20-49da-acd7-8f32d9f36367 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:54.740231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4670b-1d20-49da-acd7-8f32d9f36367 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:54.740231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4670b-1d20-49da-acd7-8f32d9f36367 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:54.741705 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 677/1338] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:54.747636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155995e-d2e1-47ca-95b8-244490ff0cd1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:54.751769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155995e-d2e1-47ca-95b8-244490ff0cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:54.751769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155995e-d2e1-47ca-95b8-244490ff0cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:54.813830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a155995e-d2e1-47ca-95b8-244490ff0cd1 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:54.815068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a155995e-d2e1-47ca-95b8-244490ff0cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:54.910773 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 662/1339] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:15:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:55.202348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4670b-1d20-49da-acd7-8f32d9f36367 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:55.203918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-daf4670b-1d20-49da-acd7-8f32d9f36367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:55.278584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:55.307039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4670b-1d20-49da-acd7-8f32d9f36367 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:55.378962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc3b8c-c9d8-4e59-8cd8-bc780f514df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:55.379556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc3b8c-c9d8-4e59-8cd8-bc780f514df8 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:55.379827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc3b8c-c9d8-4e59-8cd8-bc780f514df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:55.380097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc3b8c-c9d8-4e59-8cd8-bc780f514df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:55.381683 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2fcc3b8c-c9d8-4e59-8cd8-bc780f514df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:55.487481 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc3b8c-c9d8-4e59-8cd8-bc780f514df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:55.488831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc3b8c-c9d8-4e59-8cd8-bc780f514df8 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:55.507004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 678/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:59.687554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e44fe-eace-4651-b8ae-523723de1ec0 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:59.688138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e44fe-eace-4651-b8ae-523723de1ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:59.688138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e44fe-eace-4651-b8ae-523723de1ec0 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:59.689439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 663/1341] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:59.694684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f38b-0a8c-4ebf-9f9d-0b2043d7f595 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:59.695102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f38b-0a8c-4ebf-9f9d-0b2043d7f595 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:59.695228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f38b-0a8c-4ebf-9f9d-0b2043d7f595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:59.701179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:59.765142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1b48f38b-0a8c-4ebf-9f9d-0b2043d7f595 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:59.766332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1b48f38b-0a8c-4ebf-9f9d-0b2043d7f595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:59.862826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 679/1342] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:00.145674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e44fe-eace-4651-b8ae-523723de1ec0 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:00.147195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-721e44fe-eace-4651-b8ae-523723de1ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:00.195901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:00.253208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e44fe-eace-4651-b8ae-523723de1ec0 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:00.327172 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cecc48-463f-4984-aed9-c42f3848605d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:00.327776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cecc48-463f-4984-aed9-c42f3848605d service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:00.328046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cecc48-463f-4984-aed9-c42f3848605d service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:00.328311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cecc48-463f-4984-aed9-c42f3848605d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:00.329901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d4cecc48-463f-4984-aed9-c42f3848605d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:00.425745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:00.442463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cecc48-463f-4984-aed9-c42f3848605d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:00.443975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cecc48-463f-4984-aed9-c42f3848605d service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:00.462921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 664/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:03.325880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2f40a-e011-4ddb-be1b-ce30c905d611 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.326346 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2f40a-e011-4ddb-be1b-ce30c905d611 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.326463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2f40a-e011-4ddb-be1b-ce30c905d611 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.327773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 680/1344] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:03.333085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d6a65-cca3-44f7-a249-6e0c123ca64e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.333536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d6a65-cca3-44f7-a249-6e0c123ca64e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.333803 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d6a65-cca3-44f7-a249-6e0c123ca64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.399680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-615d6a65-cca3-44f7-a249-6e0c123ca64e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:03.400943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-615d6a65-cca3-44f7-a249-6e0c123ca64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:03.498790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 665/1345] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:03.783349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2f40a-e011-4ddb-be1b-ce30c905d611 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.784916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-94f2f40a-e011-4ddb-be1b-ce30c905d611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:03.876757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:03.893446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2f40a-e011-4ddb-be1b-ce30c905d611 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.971074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3042c-4be5-4c5e-8993-092e955c0a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.971685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3042c-4be5-4c5e-8993-092e955c0a0b service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.971960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3042c-4be5-4c5e-8993-092e955c0a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.972228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3042c-4be5-4c5e-8993-092e955c0a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.973823 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-13f3042c-4be5-4c5e-8993-092e955c0a0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:04.086003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3042c-4be5-4c5e-8993-092e955c0a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:04.088059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3042c-4be5-4c5e-8993-092e955c0a0b service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:04.106697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 681/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:08.126080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfbf57-574f-4691-bc9b-143c55f5cb47 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:08.126672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfbf57-574f-4691-bc9b-143c55f5cb47 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:08.126672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfbf57-574f-4691-bc9b-143c55f5cb47 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:08.127981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 666/1347] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:16:08.133312 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb78b3-41b4-4c2a-a92a-abc9e0661264 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:08.134859 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb78b3-41b4-4c2a-a92a-abc9e0661264 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:08.134859 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb78b3-41b4-4c2a-a92a-abc9e0661264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:08.150134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:08.203942 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fbeb78b3-41b4-4c2a-a92a-abc9e0661264 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:08.205144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fbeb78b3-41b4-4c2a-a92a-abc9e0661264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:08.312115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 682/1348] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:08.595387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfbf57-574f-4691-bc9b-143c55f5cb47 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:08.596932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cfcfbf57-574f-4691-bc9b-143c55f5cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:08.657122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:08.703637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfbf57-574f-4691-bc9b-143c55f5cb47 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:08.774817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0e90f-bd30-4de3-b4c9-49279aa1131c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:08.775342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0e90f-bd30-4de3-b4c9-49279aa1131c service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:08.775613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0e90f-bd30-4de3-b4c9-49279aa1131c service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:08.775873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0e90f-bd30-4de3-b4c9-49279aa1131c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:08.777455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-30d0e90f-bd30-4de3-b4c9-49279aa1131c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:08.881853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:08.885636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0e90f-bd30-4de3-b4c9-49279aa1131c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:08.887080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0e90f-bd30-4de3-b4c9-49279aa1131c service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:08.905698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 667/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:13.908709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07420d71-40b7-4532-acf2-8b0a1970e6ed None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:13.909165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07420d71-40b7-4532-acf2-8b0a1970e6ed None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:13.909273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07420d71-40b7-4532-acf2-8b0a1970e6ed None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:13.910611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 683/1350] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 17 16:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:13.916123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ec0ff-e3c5-48ab-adb3-b0df08c6a09d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:13.916526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ec0ff-e3c5-48ab-adb3-b0df08c6a09d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:13.916726 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ec0ff-e3c5-48ab-adb3-b0df08c6a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:14.094351 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f53ec0ff-e3c5-48ab-adb3-b0df08c6a09d None None] MFA Rules not processed for user `da5e1da2196b4ff399921809f40d3002`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:14.096035 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f53ec0ff-e3c5-48ab-adb3-b0df08c6a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:14.216156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 668/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 17 16:16:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:18.310310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=59 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:18.346277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64bbaf-06d2-4938-958d-3168f99e0870 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:18.346615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64bbaf-06d2-4938-958d-3168f99e0870 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:18.346825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64bbaf-06d2-4938-958d-3168f99e0870 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:18.348468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 684/1352] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 17 16:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:18.354692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ae23a-627c-4415-8e14-6f50470e03b3 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:18.355161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ae23a-627c-4415-8e14-6f50470e03b3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:18.355252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ae23a-627c-4415-8e14-6f50470e03b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:18.412559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:18.438228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9c5ae23a-627c-4415-8e14-6f50470e03b3 None None] MFA Rules not processed for user `da5e1da2196b4ff399921809f40d3002`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:18.439441 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9c5ae23a-627c-4415-8e14-6f50470e03b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:18.552782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 669/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 17 16:16:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:19.959928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba3845-ba5a-4311-bbce-b23ddf736c5b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:19.960460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba3845-ba5a-4311-bbce-b23ddf736c5b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:19.960460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba3845-ba5a-4311-bbce-b23ddf736c5b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:19.962503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 685/1354] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 17 16:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:19.967423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d722ed1-88ca-49dc-8c65-d04992ea0639 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:19.967865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d722ed1-88ca-49dc-8c65-d04992ea0639 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:19.968085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d722ed1-88ca-49dc-8c65-d04992ea0639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:20.043727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2d722ed1-88ca-49dc-8c65-d04992ea0639 None None] MFA Rules not processed for user `da5e1da2196b4ff399921809f40d3002`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:20.044935 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2d722ed1-88ca-49dc-8c65-d04992ea0639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:20.087704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:20.153403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 670/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 17 16:16:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:23.514895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ead7a-0cbe-4128-a0bc-cd4be588b51f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:23.516315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ead7a-0cbe-4128-a0bc-cd4be588b51f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:23.516315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ead7a-0cbe-4128-a0bc-cd4be588b51f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:23.517457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 686/1356] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:23.522997 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce065e6-e7ed-43ff-9868-619eb80ef2bf None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:23.525522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce065e6-e7ed-43ff-9868-619eb80ef2bf None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:23.525522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce065e6-e7ed-43ff-9868-619eb80ef2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:23.619400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4ce065e6-e7ed-43ff-9868-619eb80ef2bf None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:23.620681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4ce065e6-e7ed-43ff-9868-619eb80ef2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:23.749082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 671/1357] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:24.057383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac952d3c-efcd-41a8-93fb-f5804cbdd300 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:24.057670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac952d3c-efcd-41a8-93fb-f5804cbdd300 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:24.057944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac952d3c-efcd-41a8-93fb-f5804cbdd300 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:24.059269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 687/1358] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 17 16:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:24.068986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3cb98-c75d-4648-95ba-9f059d2b70e0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:24.069580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3cb98-c75d-4648-95ba-9f059d2b70e0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:24.070199 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3cb98-c75d-4648-95ba-9f059d2b70e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:24.092703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:24.156617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-21c3cb98-c75d-4648-95ba-9f059d2b70e0 None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:24.157969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-21c3cb98-c75d-4648-95ba-9f059d2b70e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:24.291979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 672/1359] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 17 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:24.299869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac952d3c-efcd-41a8-93fb-f5804cbdd300 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:24.301398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ac952d3c-efcd-41a8-93fb-f5804cbdd300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:24.459971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac952d3c-efcd-41a8-93fb-f5804cbdd300 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:24.544221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:24.585652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ed66b-48f9-4389-a614-b7f4aab23eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:24.586398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ed66b-48f9-4389-a614-b7f4aab23eca service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:24.586808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ed66b-48f9-4389-a614-b7f4aab23eca service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:24.587172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ed66b-48f9-4389-a614-b7f4aab23eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:24.588885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-954ed66b-48f9-4389-a614-b7f4aab23eca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:24.689557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ed66b-48f9-4389-a614-b7f4aab23eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:24.691367 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ed66b-48f9-4389-a614-b7f4aab23eca service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:24.711152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 688/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:26.842221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada12fd8-817c-4b04-8072-951992ceadeb None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:26.842783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada12fd8-817c-4b04-8072-951992ceadeb None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:26.842783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada12fd8-817c-4b04-8072-951992ceadeb None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:26.844298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 673/1361] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:26.849322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191be9-d2e6-4c11-902a-3abe6fb4f4f3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:26.849755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191be9-d2e6-4c11-902a-3abe6fb4f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:26.849939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191be9-d2e6-4c11-902a-3abe6fb4f4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:26.922899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b0191be9-d2e6-4c11-902a-3abe6fb4f4f3 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:26.924327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b0191be9-d2e6-4c11-902a-3abe6fb4f4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:26.963921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:27.033906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 689/1362] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:27.326825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada12fd8-817c-4b04-8072-951992ceadeb None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:27.328516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ada12fd8-817c-4b04-8072-951992ceadeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:27.400166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:27.486598 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada12fd8-817c-4b04-8072-951992ceadeb None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:27.613565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7d679-ead8-432c-a4f2-0f1261267e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:27.614254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7d679-ead8-432c-a4f2-0f1261267e11 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:27.614596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7d679-ead8-432c-a4f2-0f1261267e11 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:27.614933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7d679-ead8-432c-a4f2-0f1261267e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:27.616753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7de7d679-ead8-432c-a4f2-0f1261267e11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:27.645559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:27.725931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7d679-ead8-432c-a4f2-0f1261267e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:27.727984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7d679-ead8-432c-a4f2-0f1261267e11 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:27.753329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 674/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:30.107181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7dfba-407c-401b-b9ed-b292a3b2696b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:30.107720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7dfba-407c-401b-b9ed-b292a3b2696b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:30.107720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7dfba-407c-401b-b9ed-b292a3b2696b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:30.109237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 690/1364] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:30.114390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc50fb7-bdf9-4cc2-aa0b-dbed5f582fcc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:30.114822 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc50fb7-bdf9-4cc2-aa0b-dbed5f582fcc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:30.114918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc50fb7-bdf9-4cc2-aa0b-dbed5f582fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:30.184525 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1bc50fb7-bdf9-4cc2-aa0b-dbed5f582fcc None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:30.185666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1bc50fb7-bdf9-4cc2-aa0b-dbed5f582fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:30.290303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:30.293403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 675/1365] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:30.585237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376fd6e-5cbe-4e2f-bea0-f791ddb79018 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:30.588251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376fd6e-5cbe-4e2f-bea0-f791ddb79018 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:30.588251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376fd6e-5cbe-4e2f-bea0-f791ddb79018 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:30.588251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 691/1366] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 17 16:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:30.593859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd879e-cc9d-4013-974c-1a100eb7f641 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:30.594352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd879e-cc9d-4013-974c-1a100eb7f641 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:30.594626 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd879e-cc9d-4013-974c-1a100eb7f641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:30.675201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f3cd879e-cc9d-4013-974c-1a100eb7f641 None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:30.676693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f3cd879e-cc9d-4013-974c-1a100eb7f641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:30.803336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 676/1367] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 17 16:16:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:30.811725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376fd6e-5cbe-4e2f-bea0-f791ddb79018 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:30.813233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4376fd6e-5cbe-4e2f-bea0-f791ddb79018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:30.979799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376fd6e-5cbe-4e2f-bea0-f791ddb79018 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:31.001623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:31.101296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd418351-9fe4-44f8-a9bc-e7156efff9cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:31.102486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd418351-9fe4-44f8-a9bc-e7156efff9cc service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:31.102932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd418351-9fe4-44f8-a9bc-e7156efff9cc service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:31.103203 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd418351-9fe4-44f8-a9bc-e7156efff9cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:31.104899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dd418351-9fe4-44f8-a9bc-e7156efff9cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:31.201769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd418351-9fe4-44f8-a9bc-e7156efff9cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:31.204553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd418351-9fe4-44f8-a9bc-e7156efff9cc service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:31.224508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 692/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:31.692143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe95dc-dd2c-42d8-b2e7-1137b0874653 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:31.692666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe95dc-dd2c-42d8-b2e7-1137b0874653 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:31.692666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe95dc-dd2c-42d8-b2e7-1137b0874653 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:31.694200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 677/1369] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:31.699955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4348-4a66-4153-b888-18dbcf0516d6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:31.700241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4348-4a66-4153-b888-18dbcf0516d6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:31.700512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4348-4a66-4153-b888-18dbcf0516d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:31.734326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:31.772043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-475a4348-4a66-4153-b888-18dbcf0516d6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:31.774398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-475a4348-4a66-4153-b888-18dbcf0516d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:31.877418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 693/1370] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:32.471310 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfd77b-9f1b-4a32-b2aa-f2bb5c4cbdc5 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:32.471310 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfd77b-9f1b-4a32-b2aa-f2bb5c4cbdc5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:32.471310 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfd77b-9f1b-4a32-b2aa-f2bb5c4cbdc5 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:32.474500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 678/1371] 10.222.0.40 () {54 vars in 964 bytes} [Wed Aug 17 16:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:32.477804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e13a48-2eb0-47d5-83d3-09c676c92fb8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:32.478328 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e13a48-2eb0-47d5-83d3-09c676c92fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:32.478551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e13a48-2eb0-47d5-83d3-09c676c92fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:32.562074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a5e13a48-2eb0-47d5-83d3-09c676c92fb8 None None] MFA Rules not processed for user `4227da1895a94c9c845c4f7adf838144`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:32.563495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a5e13a48-2eb0-47d5-83d3-09c676c92fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:32.614978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:32.644928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 694/1372] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Aug 17 16:16:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:32.652837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfd77b-9f1b-4a32-b2aa-f2bb5c4cbdc5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:32.654480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-04cfd77b-9f1b-4a32-b2aa-f2bb5c4cbdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:32.718742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:32.769578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfd77b-9f1b-4a32-b2aa-f2bb5c4cbdc5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:32.849899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcf133-e933-40ec-aa09-dea301ebb786 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:32.850518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcf133-e933-40ec-aa09-dea301ebb786 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:32.850797 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcf133-e933-40ec-aa09-dea301ebb786 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:32.851067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcf133-e933-40ec-aa09-dea301ebb786 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:32.853485 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-25dcf133-e933-40ec-aa09-dea301ebb786 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:32.957176 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:32.972920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcf133-e933-40ec-aa09-dea301ebb786 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:32.975089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcf133-e933-40ec-aa09-dea301ebb786 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:32.999853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 679/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:33.376690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe95eb-0df2-45c4-9ab9-9fc1d69364f8 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:33.376969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe95eb-0df2-45c4-9ab9-9fc1d69364f8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:33.377472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe95eb-0df2-45c4-9ab9-9fc1d69364f8 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:33.378812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 695/1374] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:33.384675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112922ad-2811-4210-903d-106f3adc9a7f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:33.385062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112922ad-2811-4210-903d-106f3adc9a7f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:33.385590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112922ad-2811-4210-903d-106f3adc9a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:33.451078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-112922ad-2811-4210-903d-106f3adc9a7f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:33.452272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-112922ad-2811-4210-903d-106f3adc9a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:33.548085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 680/1375] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:33.840519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe95eb-0df2-45c4-9ab9-9fc1d69364f8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:33.842100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a4fe95eb-0df2-45c4-9ab9-9fc1d69364f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:33.989130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe95eb-0df2-45c4-9ab9-9fc1d69364f8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:34.040063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:34.102655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd380b-5cdf-435a-bcba-6b278066f502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:34.103175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd380b-5cdf-435a-bcba-6b278066f502 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:34.103449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd380b-5cdf-435a-bcba-6b278066f502 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:34.103718 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd380b-5cdf-435a-bcba-6b278066f502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:34.105305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a6bd380b-5cdf-435a-bcba-6b278066f502 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:34.194493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd380b-5cdf-435a-bcba-6b278066f502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:34.196284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd380b-5cdf-435a-bcba-6b278066f502 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:34.215293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 696/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:36.290517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a36c2-6e33-4abe-8f09-68f6437b3565 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.291020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a36c2-6e33-4abe-8f09-68f6437b3565 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.291020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a36c2-6e33-4abe-8f09-68f6437b3565 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.292308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 681/1377] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:36.297579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23092-d23a-427b-8531-43eed6127594 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.298026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23092-d23a-427b-8531-43eed6127594 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.298166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23092-d23a-427b-8531-43eed6127594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.366490 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-53f23092-d23a-427b-8531-43eed6127594 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:36.368335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-53f23092-d23a-427b-8531-43eed6127594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:36.374975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:36.466808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 697/1378] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:36.801629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a36c2-6e33-4abe-8f09-68f6437b3565 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.803179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-629a36c2-6e33-4abe-8f09-68f6437b3565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:36.871238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:36.967747 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a36c2-6e33-4abe-8f09-68f6437b3565 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:37.088905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29883afd-9368-497b-9f7f-a9b183c181da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:37.089576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883afd-9368-497b-9f7f-a9b183c181da service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:37.089855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883afd-9368-497b-9f7f-a9b183c181da service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:37.090111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883afd-9368-497b-9f7f-a9b183c181da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:37.091704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-29883afd-9368-497b-9f7f-a9b183c181da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:37.111273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:37.187744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29883afd-9368-497b-9f7f-a9b183c181da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:37.189242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29883afd-9368-497b-9f7f-a9b183c181da service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:37.209416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 682/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:39.315067 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c13ca6-6e18-4112-b57a-a96cfc042cad None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:39.315626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c13ca6-6e18-4112-b57a-a96cfc042cad None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:39.315626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c13ca6-6e18-4112-b57a-a96cfc042cad None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:39.317047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 698/1380] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:39.322754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e500b-0947-4c24-9dfd-7e8f41d61eed None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:39.323231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e500b-0947-4c24-9dfd-7e8f41d61eed None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:39.323339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e500b-0947-4c24-9dfd-7e8f41d61eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:39.394997 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f78e500b-0947-4c24-9dfd-7e8f41d61eed None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:39.396317 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f78e500b-0947-4c24-9dfd-7e8f41d61eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:39.504952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:39.517426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 683/1381] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:39.808737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c13ca6-6e18-4112-b57a-a96cfc042cad None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:39.810271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-49c13ca6-6e18-4112-b57a-a96cfc042cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:39.960157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:39.971044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c13ca6-6e18-4112-b57a-a96cfc042cad None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:40.092538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92a66c-63d9-45ac-ac74-3ba73432274f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:40.093150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92a66c-63d9-45ac-ac74-3ba73432274f service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:40.093455 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92a66c-63d9-45ac-ac74-3ba73432274f service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:40.093732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92a66c-63d9-45ac-ac74-3ba73432274f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:40.095353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ff92a66c-63d9-45ac-ac74-3ba73432274f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:40.190288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92a66c-63d9-45ac-ac74-3ba73432274f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:40.191805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92a66c-63d9-45ac-ac74-3ba73432274f service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:40.202556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:40.211465 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 699/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:42.580188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dca6f-25a0-4c9a-8286-a57ff6016eb2 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:42.580732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dca6f-25a0-4c9a-8286-a57ff6016eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:42.580732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dca6f-25a0-4c9a-8286-a57ff6016eb2 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:42.582140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 684/1383] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:42.588620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fa36-5525-45b3-ab93-aec3a56e730c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:42.589104 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fa36-5525-45b3-ab93-aec3a56e730c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:42.589335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fa36-5525-45b3-ab93-aec3a56e730c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:42.668932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8228fa36-5525-45b3-ab93-aec3a56e730c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:42.670185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8228fa36-5525-45b3-ab93-aec3a56e730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:42.781687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 700/1384] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:43.149195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dca6f-25a0-4c9a-8286-a57ff6016eb2 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.150928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-217dca6f-25a0-4c9a-8286-a57ff6016eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:43.310555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dca6f-25a0-4c9a-8286-a57ff6016eb2 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:43.397277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:43.457579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b9108-b17a-4ad3-9802-edb6c4480255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:43.458197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b9108-b17a-4ad3-9802-edb6c4480255 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.458471 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b9108-b17a-4ad3-9802-edb6c4480255 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.458758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b9108-b17a-4ad3-9802-edb6c4480255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.460400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-599b9108-b17a-4ad3-9802-edb6c4480255 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:43.563104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b9108-b17a-4ad3-9802-edb6c4480255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:43.564587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b9108-b17a-4ad3-9802-edb6c4480255 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:43.583109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 685/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:45.750756 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122b6e5-5500-4097-a75b-0af9682766e2 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.751591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122b6e5-5500-4097-a75b-0af9682766e2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.751591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122b6e5-5500-4097-a75b-0af9682766e2 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.753310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 701/1386] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:45.759746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d25b69-590b-47c4-a7a0-bab11dc7bda2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.760235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d25b69-590b-47c4-a7a0-bab11dc7bda2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.760235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d25b69-590b-47c4-a7a0-bab11dc7bda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.844646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-57d25b69-590b-47c4-a7a0-bab11dc7bda2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:45.846050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-57d25b69-590b-47c4-a7a0-bab11dc7bda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.884648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:45.954224 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 686/1387] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:46.282122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122b6e5-5500-4097-a75b-0af9682766e2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:46.283742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4122b6e5-5500-4097-a75b-0af9682766e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.370635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:46.445722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122b6e5-5500-4097-a75b-0af9682766e2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:46.562593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b491c4-5a27-4005-b18a-bed865039ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:46.563126 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b491c4-5a27-4005-b18a-bed865039ef5 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.563401 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b491c4-5a27-4005-b18a-bed865039ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.563673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b491c4-5a27-4005-b18a-bed865039ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.565280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-84b491c4-5a27-4005-b18a-bed865039ef5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.606207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:46.658773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b491c4-5a27-4005-b18a-bed865039ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:46.660397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b491c4-5a27-4005-b18a-bed865039ef5 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:46.680108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 702/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:48.615430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d57d0-d38c-4883-9363-dcd01ac12696 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.616041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d57d0-d38c-4883-9363-dcd01ac12696 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.616041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d57d0-d38c-4883-9363-dcd01ac12696 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.618258 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 687/1389] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:48.623384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d4a7-53c4-4e8c-a211-87cea3f0bf47 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.623858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d4a7-53c4-4e8c-a211-87cea3f0bf47 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.623966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d4a7-53c4-4e8c-a211-87cea3f0bf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.693020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-83a5d4a7-53c4-4e8c-a211-87cea3f0bf47 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:48.694243 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-83a5d4a7-53c4-4e8c-a211-87cea3f0bf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.733556 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b8906-32bf-40cc-9686-efb122cde8c1 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.733925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b8906-32bf-40cc-9686-efb122cde8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.734094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b8906-32bf-40cc-9686-efb122cde8c1 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.735584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 688/1390] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:48.740223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8801e-c254-42d2-995c-d40f992cf227 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.740499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8801e-c254-42d2-995c-d40f992cf227 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.740769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8801e-c254-42d2-995c-d40f992cf227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.797399 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 703/1391] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:48.809865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-efa8801e-c254-42d2-995c-d40f992cf227 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:48.811094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-efa8801e-c254-42d2-995c-d40f992cf227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.914306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 689/1392] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:49.094625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb367-de5d-4ce9-b91d-94627e86fd51 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.094912 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb367-de5d-4ce9-b91d-94627e86fd51 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.095189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb367-de5d-4ce9-b91d-94627e86fd51 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.096527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 704/1393] 10.222.0.40 () {54 vars in 967 bytes} [Wed Aug 17 16:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:49.102373 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4d8db-c1fa-492c-9555-939c2323a165 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.102663 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4d8db-c1fa-492c-9555-939c2323a165 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.102932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4d8db-c1fa-492c-9555-939c2323a165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.118814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:49.179271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-06e4d8db-c1fa-492c-9555-939c2323a165 None None] MFA Rules not processed for user `e9b8a5b38ac046ed8e8b98f0ecefb07f`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:49.180664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-06e4d8db-c1fa-492c-9555-939c2323a165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.199625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb367-de5d-4ce9-b91d-94627e86fd51 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.201185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-15fcb367-de5d-4ce9-b91d-94627e86fd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.215510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:49.259695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 690/1394] 10.222.0.40 () {58 vars in 1064 bytes} [Wed Aug 17 16:16:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:49.267499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4d8db-c1fa-492c-9555-939c2323a165 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.275458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4d8db-c1fa-492c-9555-939c2323a165 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.353452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97747110-78e7-4e3e-9ef0-f04c5f149f0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b8a5b38ac046ed8e8b98f0ecefb07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.354073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97747110-78e7-4e3e-9ef0-f04c5f149f0f service glance] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.354350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97747110-78e7-4e3e-9ef0-f04c5f149f0f service glance] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.354623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97747110-78e7-4e3e-9ef0-f04c5f149f0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.355331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb367-de5d-4ce9-b91d-94627e86fd51 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.356222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-97747110-78e7-4e3e-9ef0-f04c5f149f0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.387375 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:49.485126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97747110-78e7-4e3e-9ef0-f04c5f149f0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.486539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97747110-78e7-4e3e-9ef0-f04c5f149f0f service glance] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.508498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 691/1395] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:16:49.559399 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:49.586262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90e818-96cb-4fad-b07e-fce54e79ca29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.586872 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90e818-96cb-4fad-b07e-fce54e79ca29 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.587144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90e818-96cb-4fad-b07e-fce54e79ca29 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.587409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90e818-96cb-4fad-b07e-fce54e79ca29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.588979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-af90e818-96cb-4fad-b07e-fce54e79ca29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.683592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90e818-96cb-4fad-b07e-fce54e79ca29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.685893 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90e818-96cb-4fad-b07e-fce54e79ca29 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.705217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 705/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:16:50.395835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c653d-e8ce-44b9-90b2-be4616b3521d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.396299 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c653d-e8ce-44b9-90b2-be4616b3521d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.396407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c653d-e8ce-44b9-90b2-be4616b3521d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.464100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-035c653d-e8ce-44b9-90b2-be4616b3521d None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:50.465312 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-035c653d-e8ce-44b9-90b2-be4616b3521d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:50.546433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:50.552431 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 692/1397] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:50.599945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7165d2-5f07-482e-b385-f514d920af50 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.600229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7165d2-5f07-482e-b385-f514d920af50 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.600501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7165d2-5f07-482e-b385-f514d920af50 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.602488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 706/1398] 10.222.0.40 () {54 vars in 943 bytes} [Wed Aug 17 16:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:16:50.608752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353255b-7e0d-46c3-be4b-27fe9d0f5f38 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.609031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353255b-7e0d-46c3-be4b-27fe9d0f5f38 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.609299 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353255b-7e0d-46c3-be4b-27fe9d0f5f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.685076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b353255b-7e0d-46c3-be4b-27fe9d0f5f38 None None] MFA Rules not processed for user `6a2326353998441c938abf274b5e5dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:50.686250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b353255b-7e0d-46c3-be4b-27fe9d0f5f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:50.795835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 693/1399] 10.222.0.40 () {58 vars in 1040 bytes} [Wed Aug 17 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:50.805409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7165d2-5f07-482e-b385-f514d920af50 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:50.806921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cb7165d2-5f07-482e-b385-f514d920af50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:50.908537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:50.950149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7165d2-5f07-482e-b385-f514d920af50 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:51.057712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e566a-be39-4374-9390-5529b5f726ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:51.058320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e566a-be39-4374-9390-5529b5f726ae service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.058592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e566a-be39-4374-9390-5529b5f726ae service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.058857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e566a-be39-4374-9390-5529b5f726ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.060464 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ca1e566a-be39-4374-9390-5529b5f726ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:51.142720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e566a-be39-4374-9390-5529b5f726ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:51.144308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e566a-be39-4374-9390-5529b5f726ae service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:51.147732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:51.153782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 707/1400] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:16:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:16:51.821691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121cc96-30b4-4599-9761-b1dfd57ff091 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.822580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121cc96-30b4-4599-9761-b1dfd57ff091 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.822858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121cc96-30b4-4599-9761-b1dfd57ff091 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.824450 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 694/1401] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:51.829855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91829-248f-4a9b-a64e-caca9f55ecb6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.830666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91829-248f-4a9b-a64e-caca9f55ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.831139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91829-248f-4a9b-a64e-caca9f55ecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.928515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9de91829-248f-4a9b-a64e-caca9f55ecb6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:51.930717 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9de91829-248f-4a9b-a64e-caca9f55ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:52.040886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 708/1402] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:52.361835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121cc96-30b4-4599-9761-b1dfd57ff091 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:52.361835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a121cc96-30b4-4599-9761-b1dfd57ff091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:52.418588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:52.542399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121cc96-30b4-4599-9761-b1dfd57ff091 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:52.683631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d5279-ae4f-4dca-86b7-d30dfa42e268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:52.684254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d5279-ae4f-4dca-86b7-d30dfa42e268 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:52.684526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d5279-ae4f-4dca-86b7-d30dfa42e268 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:52.684791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d5279-ae4f-4dca-86b7-d30dfa42e268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:52.686427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-840d5279-ae4f-4dca-86b7-d30dfa42e268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:52.799563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d5279-ae4f-4dca-86b7-d30dfa42e268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:52.801863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d5279-ae4f-4dca-86b7-d30dfa42e268 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:52.825080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 695/1403] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:53.192096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:55.250878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d71c5-e337-401e-ad96-bab0d7a4e33a None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:55.251463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d71c5-e337-401e-ad96-bab0d7a4e33a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:55.251463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d71c5-e337-401e-ad96-bab0d7a4e33a None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:55.252891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 709/1404] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:55.258603 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33e81-91cb-4242-9d9d-28fb6be9ae87 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:55.259135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33e81-91cb-4242-9d9d-28fb6be9ae87 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:55.259135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd33e81-91cb-4242-9d9d-28fb6be9ae87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:55.329024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5dd33e81-91cb-4242-9d9d-28fb6be9ae87 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:55.330398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5dd33e81-91cb-4242-9d9d-28fb6be9ae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:55.432695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:55.441396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 696/1405] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:55.736314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d71c5-e337-401e-ad96-bab0d7a4e33a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:55.737995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e33d71c5-e337-401e-ad96-bab0d7a4e33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:55.840347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:55.922874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d71c5-e337-401e-ad96-bab0d7a4e33a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:56.046021 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0a869-b8e3-4b60-a282-f3ebeda7abc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:56.046637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0a869-b8e3-4b60-a282-f3ebeda7abc0 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:56.048991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0a869-b8e3-4b60-a282-f3ebeda7abc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:56.049419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0a869-b8e3-4b60-a282-f3ebeda7abc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:56.051111 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5aa0a869-b8e3-4b60-a282-f3ebeda7abc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:56.097699 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:56.153091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0a869-b8e3-4b60-a282-f3ebeda7abc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:56.154792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0a869-b8e3-4b60-a282-f3ebeda7abc0 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:56.173049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 710/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:58.245239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452d4f4-d5e3-4a3f-8e8c-c847dad73167 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:58.245786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452d4f4-d5e3-4a3f-8e8c-c847dad73167 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:58.245786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452d4f4-d5e3-4a3f-8e8c-c847dad73167 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:58.247217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 697/1407] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:16:58.252406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ad4c-7e85-4c5d-951b-b6d70d0fec16 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:58.252822 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ad4c-7e85-4c5d-951b-b6d70d0fec16 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:58.252985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ad4c-7e85-4c5d-951b-b6d70d0fec16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:58.330516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f519ad4c-7e85-4c5d-951b-b6d70d0fec16 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:58.331726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f519ad4c-7e85-4c5d-951b-b6d70d0fec16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:58.436719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 711/1408] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:58.727050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452d4f4-d5e3-4a3f-8e8c-c847dad73167 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:58.728688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c452d4f4-d5e3-4a3f-8e8c-c847dad73167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:58.896038 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452d4f4-d5e3-4a3f-8e8c-c847dad73167 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:58.975847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:59.030867 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e745a8-ea22-476a-a9a1-f54f939c3a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:59.031547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e745a8-ea22-476a-a9a1-f54f939c3a25 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:59.031935 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e745a8-ea22-476a-a9a1-f54f939c3a25 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:59.032328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e745a8-ea22-476a-a9a1-f54f939c3a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:59.034094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-65e745a8-ea22-476a-a9a1-f54f939c3a25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:59.140255 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e745a8-ea22-476a-a9a1-f54f939c3a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:59.141906 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e745a8-ea22-476a-a9a1-f54f939c3a25 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:59.164473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 698/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:08.434882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=93 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:09.162041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=65 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:14.403779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540332c-2edd-46ed-b3f5-687eefcc9cf7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:14.404326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540332c-2edd-46ed-b3f5-687eefcc9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:14.404326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540332c-2edd-46ed-b3f5-687eefcc9cf7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:14.405686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 712/1410] 10.222.0.40 () {54 vars in 918 bytes} [Wed Aug 17 16:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:14.410778 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f126-a75e-4d16-aa61-90c58c22f496 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:14.411187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f126-a75e-4d16-aa61-90c58c22f496 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:14.411322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f126-a75e-4d16-aa61-90c58c22f496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:14.486489 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2974f126-a75e-4d16-aa61-90c58c22f496 None None] MFA Rules not processed for user `da5e1da2196b4ff399921809f40d3002`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:14.487781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2974f126-a75e-4d16-aa61-90c58c22f496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:14.594074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 699/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 17 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:14.607992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae116ff-b519-4e1b-8552-6dd94e4bbb4b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:14.608277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae116ff-b519-4e1b-8552-6dd94e4bbb4b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:14.608573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae116ff-b519-4e1b-8552-6dd94e4bbb4b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:14.609947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 713/1412] 10.222.0.40 () {54 vars in 918 bytes} [Wed Aug 17 16:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:14.614426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7349f-cea0-4e67-8804-4c3fd8c2b638 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:14.614737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7349f-cea0-4e67-8804-4c3fd8c2b638 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:14.615015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7349f-cea0-4e67-8804-4c3fd8c2b638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:14.688141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:14.690612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f7e7349f-cea0-4e67-8804-4c3fd8c2b638 None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:14.691802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f7e7349f-cea0-4e67-8804-4c3fd8c2b638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:14.808221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 700/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 17 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:17.212091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba49b6-8420-4034-add3-1c8d8dfab668 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:17.212602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba49b6-8420-4034-add3-1c8d8dfab668 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:17.212602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba49b6-8420-4034-add3-1c8d8dfab668 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:17.213898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:17.219237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e528-4d5a-4e29-b962-90b42c52f759 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:17.219669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e528-4d5a-4e29-b962-90b42c52f759 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:17.219766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e528-4d5a-4e29-b962-90b42c52f759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:17.285488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9d98e528-4d5a-4e29-b962-90b42c52f759 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:17.286686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9d98e528-4d5a-4e29-b962-90b42c52f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:17.343717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:17.387319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:17.674784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba49b6-8420-4034-add3-1c8d8dfab668 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:17.676299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dcba49b6-8420-4034-add3-1c8d8dfab668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:17.819231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba49b6-8420-4034-add3-1c8d8dfab668 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:17.891892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:17.931915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec827630-0c76-404f-ab14-710fbed146ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:17.932446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec827630-0c76-404f-ab14-710fbed146ff service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:17.932718 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec827630-0c76-404f-ab14-710fbed146ff service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:17.932980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec827630-0c76-404f-ab14-710fbed146ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:17.934574 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ec827630-0c76-404f-ab14-710fbed146ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:18.021117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec827630-0c76-404f-ab14-710fbed146ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:18.022758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec827630-0c76-404f-ab14-710fbed146ff service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:18.040150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 715/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:18.926967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1b81-c21d-4c79-a731-5d65bccb2b37 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:18.927488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1b81-c21d-4c79-a731-5d65bccb2b37 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:18.927488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a1b81-c21d-4c79-a731-5d65bccb2b37 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:18.929709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:18.934758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bc9f4-40b4-4be8-aace-b6ffeeb88883 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:18.935227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bc9f4-40b4-4be8-aace-b6ffeeb88883 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:18.935341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bc9f4-40b4-4be8-aace-b6ffeeb88883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:19.010143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-699bc9f4-40b4-4be8-aace-b6ffeeb88883 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:19.011358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-699bc9f4-40b4-4be8-aace-b6ffeeb88883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:19.036959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:19.106244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:19.262605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a1b81-c21d-4c79-a731-5d65bccb2b37 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:19.264037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cd0a1b81-c21d-4c79-a731-5d65bccb2b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:19.407918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a1b81-c21d-4c79-a731-5d65bccb2b37 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:19.447857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:19.520397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838ec80-6e40-459d-ad6c-6551d23d5b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:19.521002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838ec80-6e40-459d-ad6c-6551d23d5b44 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:19.521271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838ec80-6e40-459d-ad6c-6551d23d5b44 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:19.521568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838ec80-6e40-459d-ad6c-6551d23d5b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:19.523147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c838ec80-6e40-459d-ad6c-6551d23d5b44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:19.610574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838ec80-6e40-459d-ad6c-6551d23d5b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:19.612159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838ec80-6e40-459d-ad6c-6551d23d5b44 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:19.630558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 703/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:20.524759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e1f0d-0bad-41a5-9f84-5907d36e0dc3 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:20.525354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e1f0d-0bad-41a5-9f84-5907d36e0dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:20.525354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e1f0d-0bad-41a5-9f84-5907d36e0dc3 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:20.526657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:20.531568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0251c-7a8a-48ad-b38b-980c03e2be75 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:20.531953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0251c-7a8a-48ad-b38b-980c03e2be75 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:20.532172 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0251c-7a8a-48ad-b38b-980c03e2be75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:20.707644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:20.730364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b2d0251c-7a8a-48ad-b38b-980c03e2be75 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:20.731596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b2d0251c-7a8a-48ad-b38b-980c03e2be75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:20.828736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:20.983059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e1f0d-0bad-41a5-9f84-5907d36e0dc3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:20.984556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a83e1f0d-0bad-41a5-9f84-5907d36e0dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:21.128123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e1f0d-0bad-41a5-9f84-5907d36e0dc3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:21.140370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:21.239199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64000f5-cf23-4043-a490-e5b5137f2ff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:21.239796 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64000f5-cf23-4043-a490-e5b5137f2ff8 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:21.240066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64000f5-cf23-4043-a490-e5b5137f2ff8 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:21.240329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64000f5-cf23-4043-a490-e5b5137f2ff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:21.242011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d64000f5-cf23-4043-a490-e5b5137f2ff8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:21.330500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64000f5-cf23-4043-a490-e5b5137f2ff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:21.332094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64000f5-cf23-4043-a490-e5b5137f2ff8 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:21.350463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 718/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:22.207596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe435001-a255-4f7c-9dfe-f7434f80849a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.208183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe435001-a255-4f7c-9dfe-f7434f80849a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.208183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe435001-a255-4f7c-9dfe-f7434f80849a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.209439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:22.214371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92488c5a-8d9d-48fc-bee5-6d23083ba52e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.214794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92488c5a-8d9d-48fc-bee5-6d23083ba52e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.214904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92488c5a-8d9d-48fc-bee5-6d23083ba52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.234500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:22.291668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-92488c5a-8d9d-48fc-bee5-6d23083ba52e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:22.292930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-92488c5a-8d9d-48fc-bee5-6d23083ba52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:22.393685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:22.545018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe435001-a255-4f7c-9dfe-f7434f80849a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:22.546480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fe435001-a255-4f7c-9dfe-f7434f80849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:22.655538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:22.691370 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe435001-a255-4f7c-9dfe-f7434f80849a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:22.802094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6487e3a-aff2-42c3-8b23-5699a700d727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:22.802607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487e3a-aff2-42c3-8b23-5699a700d727 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.802874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487e3a-aff2-42c3-8b23-5699a700d727 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.803136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6487e3a-aff2-42c3-8b23-5699a700d727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.805179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d6487e3a-aff2-42c3-8b23-5699a700d727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:22.880016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:22.894150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6487e3a-aff2-42c3-8b23-5699a700d727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:22.895785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6487e3a-aff2-42c3-8b23-5699a700d727 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:22.914920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 706/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:23.783395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57494f45-2f82-45c3-b753-3a35547458ca None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:23.783957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57494f45-2f82-45c3-b753-3a35547458ca None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:23.783957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57494f45-2f82-45c3-b753-3a35547458ca None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:23.785188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:23.790822 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31998b5-3884-438a-9a2d-df0900f93a46 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:23.791254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31998b5-3884-438a-9a2d-df0900f93a46 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:23.791349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31998b5-3884-438a-9a2d-df0900f93a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:23.868689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a31998b5-3884-438a-9a2d-df0900f93a46 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:23.869913 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a31998b5-3884-438a-9a2d-df0900f93a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:23.965275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:24.117720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57494f45-2f82-45c3-b753-3a35547458ca None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:24.119229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-57494f45-2f82-45c3-b753-3a35547458ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:24.202365 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:24.264289 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57494f45-2f82-45c3-b753-3a35547458ca None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:24.376308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb749a9-e2c8-491c-a57c-d8e388cd30da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:24.377242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb749a9-e2c8-491c-a57c-d8e388cd30da service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:24.377741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb749a9-e2c8-491c-a57c-d8e388cd30da service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:24.378217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb749a9-e2c8-491c-a57c-d8e388cd30da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:24.380900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-adb749a9-e2c8-491c-a57c-d8e388cd30da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:24.428151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:24.469427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb749a9-e2c8-491c-a57c-d8e388cd30da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:24.471056 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb749a9-e2c8-491c-a57c-d8e388cd30da service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:24.489232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 721/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:25.332188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140d14-8c90-41d4-a1e2-3b9ef3d4071f None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.332707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140d14-8c90-41d4-a1e2-3b9ef3d4071f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.332707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40140d14-8c90-41d4-a1e2-3b9ef3d4071f None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.334050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:25.339363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a4d98-1537-4881-a01d-a34a0db850f7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.339767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a4d98-1537-4881-a01d-a34a0db850f7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.339903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a4d98-1537-4881-a01d-a34a0db850f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.414385 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a12a4d98-1537-4881-a01d-a34a0db850f7 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:25.415579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a12a4d98-1537-4881-a01d-a34a0db850f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.510601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:25.660897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40140d14-8c90-41d4-a1e2-3b9ef3d4071f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.662453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-40140d14-8c90-41d4-a1e2-3b9ef3d4071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.711930 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:25.808754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40140d14-8c90-41d4-a1e2-3b9ef3d4071f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:25.921078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebed9b-1310-4834-8a9b-0e79b1594cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:25.921661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebed9b-1310-4834-8a9b-0e79b1594cc7 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.921938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebed9b-1310-4834-8a9b-0e79b1594cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.922204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebed9b-1310-4834-8a9b-0e79b1594cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.923783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f2ebed9b-1310-4834-8a9b-0e79b1594cc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.931208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:26.013716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebed9b-1310-4834-8a9b-0e79b1594cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.015297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebed9b-1310-4834-8a9b-0e79b1594cc7 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.033247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 709/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:26.869435 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda480bf-3054-4f51-91b4-4ed8de935dd9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.869968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda480bf-3054-4f51-91b4-4ed8de935dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.869968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda480bf-3054-4f51-91b4-4ed8de935dd9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.871333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:26.876221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235177-5b9e-483f-b3f7-16ebe607bad5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.876661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235177-5b9e-483f-b3f7-16ebe607bad5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.876788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235177-5b9e-483f-b3f7-16ebe607bad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.957934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3c235177-5b9e-483f-b3f7-16ebe607bad5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:26.959147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3c235177-5b9e-483f-b3f7-16ebe607bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:27.025559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:27.053235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:27.205890 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda480bf-3054-4f51-91b4-4ed8de935dd9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:27.207325 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cda480bf-3054-4f51-91b4-4ed8de935dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:27.224423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:27.352011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda480bf-3054-4f51-91b4-4ed8de935dd9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:27.438707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:27.463735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad2b55-c763-49bd-a7e0-c3facd919b37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:27.464571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2b55-c763-49bd-a7e0-c3facd919b37 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.464843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2b55-c763-49bd-a7e0-c3facd919b37 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.465101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2b55-c763-49bd-a7e0-c3facd919b37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.466705 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7fad2b55-c763-49bd-a7e0-c3facd919b37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:27.554753 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad2b55-c763-49bd-a7e0-c3facd919b37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.556433 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad2b55-c763-49bd-a7e0-c3facd919b37 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.573988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 724/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:28.428622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96ee4-1f92-4641-8c18-94ffbc73de32 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:28.429722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96ee4-1f92-4641-8c18-94ffbc73de32 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:28.429829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa96ee4-1f92-4641-8c18-94ffbc73de32 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:28.431137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:28.435988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f447b-5062-4b49-89a3-3ee9180e690a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:28.436454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f447b-5062-4b49-89a3-3ee9180e690a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:28.436561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f447b-5062-4b49-89a3-3ee9180e690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:28.512298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b18f447b-5062-4b49-89a3-3ee9180e690a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:28.513518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b18f447b-5062-4b49-89a3-3ee9180e690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:28.553184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:28.609261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:28.760094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa96ee4-1f92-4641-8c18-94ffbc73de32 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:28.761549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0fa96ee4-1f92-4641-8c18-94ffbc73de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:28.907693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa96ee4-1f92-4641-8c18-94ffbc73de32 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:28.962384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:29.021892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84028d4-9072-4798-9769-146d0ca22ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:29.023039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84028d4-9072-4798-9769-146d0ca22ada service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:29.023350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84028d4-9072-4798-9769-146d0ca22ada service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:29.023640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84028d4-9072-4798-9769-146d0ca22ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:29.025221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b84028d4-9072-4798-9769-146d0ca22ada service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:29.113121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84028d4-9072-4798-9769-146d0ca22ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:29.114740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84028d4-9072-4798-9769-146d0ca22ada service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:29.133734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 712/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:29.978328 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d57257-25d1-43b6-84d4-55cb14f74f81 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:29.978891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d57257-25d1-43b6-84d4-55cb14f74f81 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:29.978891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d57257-25d1-43b6-84d4-55cb14f74f81 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:29.980213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:29.985059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf1e8-f653-4e0c-999a-14494a6deb06 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:29.985516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf1e8-f653-4e0c-999a-14494a6deb06 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:29.985630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf1e8-f653-4e0c-999a-14494a6deb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:30.062682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7a2cf1e8-f653-4e0c-999a-14494a6deb06 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:30.063907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7a2cf1e8-f653-4e0c-999a-14494a6deb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:30.065930 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:30.160171 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:30.309949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d57257-25d1-43b6-84d4-55cb14f74f81 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:30.311459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-95d57257-25d1-43b6-84d4-55cb14f74f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:30.454248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d57257-25d1-43b6-84d4-55cb14f74f81 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:30.480321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:30.564897 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a50be-36c0-4de2-8014-9e1efa27309e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:30.565523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a50be-36c0-4de2-8014-9e1efa27309e service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:30.565795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a50be-36c0-4de2-8014-9e1efa27309e service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:30.566058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a50be-36c0-4de2-8014-9e1efa27309e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:30.567675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cb6a50be-36c0-4de2-8014-9e1efa27309e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:30.664375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a50be-36c0-4de2-8014-9e1efa27309e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:30.666000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a50be-36c0-4de2-8014-9e1efa27309e service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:30.683833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 727/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:32.499659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3194d-f685-42d0-9c32-3f021277bd4e None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.500210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3194d-f685-42d0-9c32-3f021277bd4e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.500210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3194d-f685-42d0-9c32-3f021277bd4e None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.501673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:32.507587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87181b-c0d4-4c79-8d1c-21e602d70673 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.508022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87181b-c0d4-4c79-8d1c-21e602d70673 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.508134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87181b-c0d4-4c79-8d1c-21e602d70673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.548353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:32.574362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2e87181b-c0d4-4c79-8d1c-21e602d70673 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:32.575550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2e87181b-c0d4-4c79-8d1c-21e602d70673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:32.670047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:32.953397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3194d-f685-42d0-9c32-3f021277bd4e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:32.954948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0ea3194d-f685-42d0-9c32-3f021277bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:33.060122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3194d-f685-42d0-9c32-3f021277bd4e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:33.092195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:33.134075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc372c7a-7b74-48b8-88b9-8f7440ffdb20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:33.134655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372c7a-7b74-48b8-88b9-8f7440ffdb20 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:33.134930 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372c7a-7b74-48b8-88b9-8f7440ffdb20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:33.135200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372c7a-7b74-48b8-88b9-8f7440ffdb20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:33.136825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-dc372c7a-7b74-48b8-88b9-8f7440ffdb20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:33.246420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc372c7a-7b74-48b8-88b9-8f7440ffdb20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:33.247757 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc372c7a-7b74-48b8-88b9-8f7440ffdb20 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:33.266362 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 715/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:35.298147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edea196-29e4-4ad2-89bf-3063d3b887c5 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.298686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edea196-29e4-4ad2-89bf-3063d3b887c5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.298686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edea196-29e4-4ad2-89bf-3063d3b887c5 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.299953 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:35.305879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da96cd-b6d6-40bf-a099-adc5a930684c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.306308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da96cd-b6d6-40bf-a099-adc5a930684c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.306451 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da96cd-b6d6-40bf-a099-adc5a930684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.372142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b2da96cd-b6d6-40bf-a099-adc5a930684c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:35.373332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b2da96cd-b6d6-40bf-a099-adc5a930684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:35.386730 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:35.469550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:35.752641 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edea196-29e4-4ad2-89bf-3063d3b887c5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:35.754194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1edea196-29e4-4ad2-89bf-3063d3b887c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:35.855826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edea196-29e4-4ad2-89bf-3063d3b887c5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:35.868350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:35.930088 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6053f4-cb58-4386-a84f-acdc3282b99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:35.930686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6053f4-cb58-4386-a84f-acdc3282b99d service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.930959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6053f4-cb58-4386-a84f-acdc3282b99d service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.931226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6053f4-cb58-4386-a84f-acdc3282b99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.932794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ca6053f4-cb58-4386-a84f-acdc3282b99d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:36.037224 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6053f4-cb58-4386-a84f-acdc3282b99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:36.038703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6053f4-cb58-4386-a84f-acdc3282b99d service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:36.056655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 730/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:38.279898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31545-2a9e-4ca6-8c35-0b1f3eec1c8a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.280436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31545-2a9e-4ca6-8c35-0b1f3eec1c8a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.280436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e31545-2a9e-4ca6-8c35-0b1f3eec1c8a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.281727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:38.286858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bb7be-c02d-4def-b515-2536436e1f47 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.287302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bb7be-c02d-4def-b515-2536436e1f47 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.287398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bb7be-c02d-4def-b515-2536436e1f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.336539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:38.354850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-130bb7be-c02d-4def-b515-2536436e1f47 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:38.356096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-130bb7be-c02d-4def-b515-2536436e1f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:38.453334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:38.736621 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e31545-2a9e-4ca6-8c35-0b1f3eec1c8a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:38.738191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-92e31545-2a9e-4ca6-8c35-0b1f3eec1c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:38.841151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e31545-2a9e-4ca6-8c35-0b1f3eec1c8a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:38.880571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:38.915514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2425a7c-8373-424a-8618-997753fe8af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:38.916118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2425a7c-8373-424a-8618-997753fe8af0 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.916393 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2425a7c-8373-424a-8618-997753fe8af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.916663 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2425a7c-8373-424a-8618-997753fe8af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.918291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d2425a7c-8373-424a-8618-997753fe8af0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:39.028802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2425a7c-8373-424a-8618-997753fe8af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:39.030192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2425a7c-8373-424a-8618-997753fe8af0 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:39.048935 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 718/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:41.112444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0edf6-8523-4c04-be93-bb0ef5b8f993 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:41.113025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0edf6-8523-4c04-be93-bb0ef5b8f993 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:41.113025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0edf6-8523-4c04-be93-bb0ef5b8f993 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:41.114408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:41.120755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267499c-3e62-4803-b5cf-937dc3b86b6a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:41.121197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267499c-3e62-4803-b5cf-937dc3b86b6a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:41.121308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267499c-3e62-4803-b5cf-937dc3b86b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:41.197691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8267499c-3e62-4803-b5cf-937dc3b86b6a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:41.198827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8267499c-3e62-4803-b5cf-937dc3b86b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:41.224406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:41.313566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:41.603109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0edf6-8523-4c04-be93-bb0ef5b8f993 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:41.604636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-87f0edf6-8523-4c04-be93-bb0ef5b8f993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:41.753296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0edf6-8523-4c04-be93-bb0ef5b8f993 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:41.774811 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:41.829037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd42ab-f520-4045-87d5-3a2b08abecd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:41.829668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd42ab-f520-4045-87d5-3a2b08abecd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:41.829940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd42ab-f520-4045-87d5-3a2b08abecd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:41.830211 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd42ab-f520-4045-87d5-3a2b08abecd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:41.831790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-09fd42ab-f520-4045-87d5-3a2b08abecd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:41.940188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd42ab-f520-4045-87d5-3a2b08abecd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:41.941655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd42ab-f520-4045-87d5-3a2b08abecd2 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:41.960785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 733/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:43.916079 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf10fb2-0223-4327-b76d-99b621b48ff4 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.916567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf10fb2-0223-4327-b76d-99b621b48ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.916673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf10fb2-0223-4327-b76d-99b621b48ff4 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.918033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:43.923429 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84b69b-296c-4e07-a581-da84f6180bd7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.923855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84b69b-296c-4e07-a581-da84f6180bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.923967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84b69b-296c-4e07-a581-da84f6180bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.986750 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:43.989561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cf84b69b-296c-4e07-a581-da84f6180bd7 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:43.990881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cf84b69b-296c-4e07-a581-da84f6180bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:44.085348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:44.377595 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf10fb2-0223-4327-b76d-99b621b48ff4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:44.379162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fbf10fb2-0223-4327-b76d-99b621b48ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:44.483252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf10fb2-0223-4327-b76d-99b621b48ff4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:44.532689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:44.558718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ecd57-01bb-49d9-8c18-c713725d0f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:44.559315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ecd57-01bb-49d9-8c18-c713725d0f08 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:44.559582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ecd57-01bb-49d9-8c18-c713725d0f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:44.559896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ecd57-01bb-49d9-8c18-c713725d0f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:44.562117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-500ecd57-01bb-49d9-8c18-c713725d0f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:44.668787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ecd57-01bb-49d9-8c18-c713725d0f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:44.670156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ecd57-01bb-49d9-8c18-c713725d0f08 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:44.689803 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 721/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:46.686276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ea46-4579-4a4d-8de0-efc45c67b349 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:46.686818 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ea46-4579-4a4d-8de0-efc45c67b349 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:46.686818 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ea46-4579-4a4d-8de0-efc45c67b349 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:46.688144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:46.694099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636e04a-1eec-48df-b22d-1bf9aaceafd5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:46.694538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636e04a-1eec-48df-b22d-1bf9aaceafd5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:46.694646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636e04a-1eec-48df-b22d-1bf9aaceafd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:46.759356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2636e04a-1eec-48df-b22d-1bf9aaceafd5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:46.760590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2636e04a-1eec-48df-b22d-1bf9aaceafd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:46.790432 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:46.858148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:47.144261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ea46-4579-4a4d-8de0-efc45c67b349 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:47.145851 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cdc8ea46-4579-4a4d-8de0-efc45c67b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:47.247123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ea46-4579-4a4d-8de0-efc45c67b349 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:47.274548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:47.318924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776abd50-38b8-4c74-b993-e50d17eec2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:47.319513 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776abd50-38b8-4c74-b993-e50d17eec2ed service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:47.319785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776abd50-38b8-4c74-b993-e50d17eec2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:47.320049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776abd50-38b8-4c74-b993-e50d17eec2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:47.321639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-776abd50-38b8-4c74-b993-e50d17eec2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:47.429641 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776abd50-38b8-4c74-b993-e50d17eec2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:47.431015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776abd50-38b8-4c74-b993-e50d17eec2ed service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:47.449034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 736/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:49.435193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2ebd2-283c-4d02-988b-5b413a421fa5 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:49.435791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2ebd2-283c-4d02-988b-5b413a421fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:49.435791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2ebd2-283c-4d02-988b-5b413a421fa5 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:49.437075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:49.442266 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea3a2-fb04-4222-b658-822405133691 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:49.442716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea3a2-fb04-4222-b658-822405133691 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:49.442820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eea3a2-fb04-4222-b658-822405133691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:49.509572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-20eea3a2-fb04-4222-b658-822405133691 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:49.510766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-20eea3a2-fb04-4222-b658-822405133691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:49.518973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:49.607940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:49.890853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2ebd2-283c-4d02-988b-5b413a421fa5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:49.892518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bcb2ebd2-283c-4d02-988b-5b413a421fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:49.996409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2ebd2-283c-4d02-988b-5b413a421fa5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:50.052327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:50.073677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21f669-7332-4f60-9b86-173c6d6f3959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:50.074280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f669-7332-4f60-9b86-173c6d6f3959 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:50.074553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f669-7332-4f60-9b86-173c6d6f3959 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:50.074817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f669-7332-4f60-9b86-173c6d6f3959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:50.077198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ac21f669-7332-4f60-9b86-173c6d6f3959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:50.185078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21f669-7332-4f60-9b86-173c6d6f3959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:50.186450 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21f669-7332-4f60-9b86-173c6d6f3959 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:50.204808 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 724/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:52.164060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563baed-4cfa-4ea7-aaf3-c4856625188f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:52.164623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563baed-4cfa-4ea7-aaf3-c4856625188f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:52.164623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563baed-4cfa-4ea7-aaf3-c4856625188f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:52.165904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:52.171011 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7bd95-6efb-435b-be9c-dbad17d2b685 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:52.171442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7bd95-6efb-435b-be9c-dbad17d2b685 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:52.171554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7bd95-6efb-435b-be9c-dbad17d2b685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:52.237063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-28f7bd95-6efb-435b-be9c-dbad17d2b685 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:52.238273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-28f7bd95-6efb-435b-be9c-dbad17d2b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:52.277466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:52.336962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:52.627720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563baed-4cfa-4ea7-aaf3-c4856625188f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:52.629260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5563baed-4cfa-4ea7-aaf3-c4856625188f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:52.735479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563baed-4cfa-4ea7-aaf3-c4856625188f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:52.774054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:52.810154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b75ac-828b-4d6d-ab83-634749577118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:52.810760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b75ac-828b-4d6d-ab83-634749577118 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:52.811034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b75ac-828b-4d6d-ab83-634749577118 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:52.811301 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b75ac-828b-4d6d-ab83-634749577118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:52.812889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4a3b75ac-828b-4d6d-ab83-634749577118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:52.921798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b75ac-828b-4d6d-ab83-634749577118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:52.923239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b75ac-828b-4d6d-ab83-634749577118 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:52.941964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 739/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:54.831248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68417a45-d191-4e04-af88-bc595178fed1 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:54.831811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68417a45-d191-4e04-af88-bc595178fed1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:54.831811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68417a45-d191-4e04-af88-bc595178fed1 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:54.833179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:54.838862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945d28-a529-4fac-999a-65d5ed1b486b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:54.839290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945d28-a529-4fac-999a-65d5ed1b486b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:54.839393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945d28-a529-4fac-999a-65d5ed1b486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:54.903942 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-27945d28-a529-4fac-999a-65d5ed1b486b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:54.905109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-27945d28-a529-4fac-999a-65d5ed1b486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:54.923328 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:55.000797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:55.280400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68417a45-d191-4e04-af88-bc595178fed1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:55.282003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-68417a45-d191-4e04-af88-bc595178fed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:55.386108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68417a45-d191-4e04-af88-bc595178fed1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:55.452770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:55.459153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6a934-5cef-4a9f-b445-cd2f4ed9984e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:55.459956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6a934-5cef-4a9f-b445-cd2f4ed9984e service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:55.460233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6a934-5cef-4a9f-b445-cd2f4ed9984e service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:55.460500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6a934-5cef-4a9f-b445-cd2f4ed9984e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:55.462133 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-26a6a934-5cef-4a9f-b445-cd2f4ed9984e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:55.571428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6a934-5cef-4a9f-b445-cd2f4ed9984e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:55.572870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6a934-5cef-4a9f-b445-cd2f4ed9984e service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:55.591352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 727/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:57.510890 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879119-92de-49c4-a7dd-7b3580c3e018 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:57.511458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879119-92de-49c4-a7dd-7b3580c3e018 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:57.511458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879119-92de-49c4-a7dd-7b3580c3e018 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:57.512833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:57.518115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1638-9fb4-4d5c-b637-80659ae3a79a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:57.518532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1638-9fb4-4d5c-b637-80659ae3a79a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:57.518651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1638-9fb4-4d5c-b637-80659ae3a79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:57.585821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-895f1638-9fb4-4d5c-b637-80659ae3a79a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:57.587050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-895f1638-9fb4-4d5c-b637-80659ae3a79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:57.637723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:57.687529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:57.969001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e879119-92de-49c4-a7dd-7b3580c3e018 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:57.970643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0e879119-92de-49c4-a7dd-7b3580c3e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:58.073781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e879119-92de-49c4-a7dd-7b3580c3e018 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:58.120512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:58.146663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393013c-38c3-4a97-80b1-494dd678b1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:58.147903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393013c-38c3-4a97-80b1-494dd678b1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:58.149027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393013c-38c3-4a97-80b1-494dd678b1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:58.149550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393013c-38c3-4a97-80b1-494dd678b1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:58.151489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e393013c-38c3-4a97-80b1-494dd678b1d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:58.257586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393013c-38c3-4a97-80b1-494dd678b1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:58.258937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393013c-38c3-4a97-80b1-494dd678b1d2 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:58.277155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 742/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:07.702980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=22 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:08.274948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=66 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:17.696877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1348d83-87df-4151-a261-bbfb8c6ac51e None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:17.697445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1348d83-87df-4151-a261-bbfb8c6ac51e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:17.697445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1348d83-87df-4151-a261-bbfb8c6ac51e None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:17.698693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 729/1471] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:18:17.703857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cdd05-df63-46ab-8f62-991f9336d687 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:17.704245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cdd05-df63-46ab-8f62-991f9336d687 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:17.704417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cdd05-df63-46ab-8f62-991f9336d687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:17.769156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-297cdd05-df63-46ab-8f62-991f9336d687 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:17.770374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-297cdd05-df63-46ab-8f62-991f9336d687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:17.866694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 743/1472] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:18.166924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938adfd-a211-4acc-b7ab-1e435a553473 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:18.167197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938adfd-a211-4acc-b7ab-1e435a553473 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:18.167459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938adfd-a211-4acc-b7ab-1e435a553473 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:18.168778 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 730/1473] 10.222.0.40 () {54 vars in 967 bytes} [Wed Aug 17 16:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:18:18.173795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1f045-7f9e-4a54-bfbf-86c74efbd592 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:18.174115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1f045-7f9e-4a54-bfbf-86c74efbd592 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:18.174393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1f045-7f9e-4a54-bfbf-86c74efbd592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:18.249895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-58f1f045-7f9e-4a54-bfbf-86c74efbd592 None None] MFA Rules not processed for user `e9b8a5b38ac046ed8e8b98f0ecefb07f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:18.251098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-58f1f045-7f9e-4a54-bfbf-86c74efbd592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:18.272790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:18.327625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 744/1474] 10.222.0.40 () {58 vars in 1064 bytes} [Wed Aug 17 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:18.336085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938adfd-a211-4acc-b7ab-1e435a553473 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:18.337629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8938adfd-a211-4acc-b7ab-1e435a553473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:18.438845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938adfd-a211-4acc-b7ab-1e435a553473 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:18.511232 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357a30d-3819-4be2-8085-16b88ef3d387 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b8a5b38ac046ed8e8b98f0ecefb07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:18.511827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357a30d-3819-4be2-8085-16b88ef3d387 service glance] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:18.512097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357a30d-3819-4be2-8085-16b88ef3d387 service glance] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:18.512360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357a30d-3819-4be2-8085-16b88ef3d387 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:18.513966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3357a30d-3819-4be2-8085-16b88ef3d387 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:18.566995 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:18.621665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357a30d-3819-4be2-8085-16b88ef3d387 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:18.623098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357a30d-3819-4be2-8085-16b88ef3d387 service glance] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:18.641889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 731/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:20.635255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456f36c-48ee-455d-98f6-06d6a16c6160 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:20.635921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456f36c-48ee-455d-98f6-06d6a16c6160 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:20.635921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456f36c-48ee-455d-98f6-06d6a16c6160 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:20.637150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 745/1476] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:18:20.642326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833af76-60df-4017-a26c-1d5e28896cab None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:20.642793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833af76-60df-4017-a26c-1d5e28896cab None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:20.642913 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833af76-60df-4017-a26c-1d5e28896cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:20.710032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2833af76-60df-4017-a26c-1d5e28896cab None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:20.711249 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2833af76-60df-4017-a26c-1d5e28896cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:20.812939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 732/1477] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:21.089267 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456f36c-48ee-455d-98f6-06d6a16c6160 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:21.090832 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d456f36c-48ee-455d-98f6-06d6a16c6160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:21.215000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456f36c-48ee-455d-98f6-06d6a16c6160 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:21.263174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:21.307874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e07cf-d317-43a4-8cc2-69dfecca76bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:21.308479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e07cf-d317-43a4-8cc2-69dfecca76bb admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:21.308751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e07cf-d317-43a4-8cc2-69dfecca76bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:21.309016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e07cf-d317-43a4-8cc2-69dfecca76bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:21.309679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e07cf-d317-43a4-8cc2-69dfecca76bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:21.311389 dv-cinder-852208-6-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-2b3e07cf-d317-43a4-8cc2-69dfecca76bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:18:21.311389 dv-cinder-852208-6-smb devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 16:18:21.311389 dv-cinder-852208-6-smb devstack@keystone.service[81778]: Aug 17 16:18:21.312525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e07cf-d317-43a4-8cc2-69dfecca76bb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:21.330745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 746/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 17 16:18:21 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:18:23.254536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927fe0-3716-4206-ad6d-bb9490bf436c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:23.255124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927fe0-3716-4206-ad6d-bb9490bf436c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:23.255124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927fe0-3716-4206-ad6d-bb9490bf436c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:23.256375 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 733/1479] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:18:23.261517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156135b-9bee-4746-942c-c50bd38b6756 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:23.261917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156135b-9bee-4746-942c-c50bd38b6756 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:23.262078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156135b-9bee-4746-942c-c50bd38b6756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:23.327106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7156135b-9bee-4746-942c-c50bd38b6756 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:23.328331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7156135b-9bee-4746-942c-c50bd38b6756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:23.425096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 747/1480] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:23.718445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927fe0-3716-4206-ad6d-bb9490bf436c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:23.719954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-69927fe0-3716-4206-ad6d-bb9490bf436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:23.729916 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:23.863859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927fe0-3716-4206-ad6d-bb9490bf436c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:23.946021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:23.980035 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6ba9c-e766-4265-a239-90364c9ce7e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:23.980575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6ba9c-e766-4265-a239-90364c9ce7e6 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:23.980847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6ba9c-e766-4265-a239-90364c9ce7e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:23.981111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6ba9c-e766-4265-a239-90364c9ce7e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:23.982727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-18a6ba9c-e766-4265-a239-90364c9ce7e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:24.070535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6ba9c-e766-4265-a239-90364c9ce7e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:24.072122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6ba9c-e766-4265-a239-90364c9ce7e6 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:24.090328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 734/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:26.173084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709cb15-c15a-4101-be96-af2dd254e0a0 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:26.173633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709cb15-c15a-4101-be96-af2dd254e0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:26.173633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709cb15-c15a-4101-be96-af2dd254e0a0 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:26.174955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 748/1482] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:18:26.181130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86804b-0268-4b6b-8ea7-a7f9a13fbbb0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:26.181656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86804b-0268-4b6b-8ea7-a7f9a13fbbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:26.181765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86804b-0268-4b6b-8ea7-a7f9a13fbbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:26.248159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-db86804b-0268-4b6b-8ea7-a7f9a13fbbb0 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:26.249396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-db86804b-0268-4b6b-8ea7-a7f9a13fbbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:26.295167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:26.344852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 735/1483] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:26.630297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709cb15-c15a-4101-be96-af2dd254e0a0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:26.631888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f709cb15-c15a-4101-be96-af2dd254e0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:26.655281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:26.732376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709cb15-c15a-4101-be96-af2dd254e0a0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:26.804637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38977d08-367d-4e2d-9191-29f6f2b0697e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:26.805237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977d08-367d-4e2d-9191-29f6f2b0697e service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:26.805539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977d08-367d-4e2d-9191-29f6f2b0697e service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:26.805806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977d08-367d-4e2d-9191-29f6f2b0697e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:26.807381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-38977d08-367d-4e2d-9191-29f6f2b0697e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:26.880738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:26.915961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38977d08-367d-4e2d-9191-29f6f2b0697e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:26.917421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38977d08-367d-4e2d-9191-29f6f2b0697e service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:26.935864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 749/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:28.885586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ababc-d6a4-4b58-b1ff-740073fb61a1 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:28.886119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ababc-d6a4-4b58-b1ff-740073fb61a1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:28.886119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ababc-d6a4-4b58-b1ff-740073fb61a1 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:28.887795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 736/1485] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:18:28.893043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f4081-a3d0-4bcc-afed-b1478a17b81f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:28.893496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f4081-a3d0-4bcc-afed-b1478a17b81f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:28.893630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f4081-a3d0-4bcc-afed-b1478a17b81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:28.960044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9d0f4081-a3d0-4bcc-afed-b1478a17b81f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:28.961168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9d0f4081-a3d0-4bcc-afed-b1478a17b81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:29.057865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 750/1486] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:29.346111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ababc-d6a4-4b58-b1ff-740073fb61a1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:29.347644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-479ababc-d6a4-4b58-b1ff-740073fb61a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:29.453623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ababc-d6a4-4b58-b1ff-740073fb61a1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:29.525182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:29.526922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7b35f-82a0-47e2-b887-e64fd73e84c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:29.527522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7b35f-82a0-47e2-b887-e64fd73e84c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:29.527795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7b35f-82a0-47e2-b887-e64fd73e84c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:29.528057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7b35f-82a0-47e2-b887-e64fd73e84c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:29.529665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-78d7b35f-82a0-47e2-b887-e64fd73e84c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:29.638392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7b35f-82a0-47e2-b887-e64fd73e84c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:29.639819 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7b35f-82a0-47e2-b887-e64fd73e84c6 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:29.658117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 737/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:31.651007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8993-15bc-459c-84ac-006df5040141 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:31.651629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8993-15bc-459c-84ac-006df5040141 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:31.651629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8993-15bc-459c-84ac-006df5040141 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:31.652950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 751/1488] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:18:31.658028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cb460-3211-4a1a-89dc-b8ecc5c636bd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:31.658457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cb460-3211-4a1a-89dc-b8ecc5c636bd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:31.658566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cb460-3211-4a1a-89dc-b8ecc5c636bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:31.729729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-605cb460-3211-4a1a-89dc-b8ecc5c636bd None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:31.730940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-605cb460-3211-4a1a-89dc-b8ecc5c636bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:31.783378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:31.827770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 738/1489] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:32.117375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a8993-15bc-459c-84ac-006df5040141 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:32.118936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f30a8993-15bc-459c-84ac-006df5040141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:32.154197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:32.220457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a8993-15bc-459c-84ac-006df5040141 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:32.290842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce44cb6-89fd-48ae-aaf2-e05e4068154c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:32.291444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce44cb6-89fd-48ae-aaf2-e05e4068154c service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:32.291744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce44cb6-89fd-48ae-aaf2-e05e4068154c service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:32.291983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce44cb6-89fd-48ae-aaf2-e05e4068154c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:32.293580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3ce44cb6-89fd-48ae-aaf2-e05e4068154c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:32.372546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:32.401835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce44cb6-89fd-48ae-aaf2-e05e4068154c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:32.403277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce44cb6-89fd-48ae-aaf2-e05e4068154c service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:32.422291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 752/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:34.821043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d063618-d484-4325-a33a-a600c4bef4a6 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:34.821553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d063618-d484-4325-a33a-a600c4bef4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:34.821666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d063618-d484-4325-a33a-a600c4bef4a6 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:34.822965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 739/1491] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 17 16:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:18:34.828152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800bb04-455d-46ab-9993-032032db48b6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:34.828593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800bb04-455d-46ab-9993-032032db48b6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:34.828702 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800bb04-455d-46ab-9993-032032db48b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:34.894660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4800bb04-455d-46ab-9993-032032db48b6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:34.895967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4800bb04-455d-46ab-9993-032032db48b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:34.991904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 753/1492] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 17 16:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:35.280371 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d063618-d484-4325-a33a-a600c4bef4a6 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:35.281943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9d063618-d484-4325-a33a-a600c4bef4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:35.385815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d063618-d484-4325-a33a-a600c4bef4a6 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:35.461577 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa45c0f-3a47-4e51-828c-520cadc4eaa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:35.462186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa45c0f-3a47-4e51-828c-520cadc4eaa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:35.462462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa45c0f-3a47-4e51-828c-520cadc4eaa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:35.462728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa45c0f-3a47-4e51-828c-520cadc4eaa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:35.464314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7aa45c0f-3a47-4e51-828c-520cadc4eaa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:35.473308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:35.573441 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa45c0f-3a47-4e51-828c-520cadc4eaa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:35.574818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa45c0f-3a47-4e51-828c-520cadc4eaa1 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:35.593166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 740/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:44.989479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=82 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:45.590899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=50 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:55.309897 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63ec96-4570-48a9-902d-f3d9f2104a47 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:55.310518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63ec96-4570-48a9-902d-f3d9f2104a47 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:55.310518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63ec96-4570-48a9-902d-f3d9f2104a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:55.386287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5c63ec96-4570-48a9-902d-f3d9f2104a47 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:55.387472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5c63ec96-4570-48a9-902d-f3d9f2104a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:55.481754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 754/1494] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:55.489788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda28d-b5b3-443c-b621-e8aa3db206fe None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:55.490278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda28d-b5b3-443c-b621-e8aa3db206fe None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:55.490383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda28d-b5b3-443c-b621-e8aa3db206fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:55.585002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b1bda28d-b5b3-443c-b621-e8aa3db206fe None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:55.585002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b1bda28d-b5b3-443c-b621-e8aa3db206fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:55.670161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 741/1495] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:55.675296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63ec96-4570-48a9-902d-f3d9f2104a47 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:55.676487 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5c63ec96-4570-48a9-902d-f3d9f2104a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:55.688028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63ec96-4570-48a9-902d-f3d9f2104a47 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:55.749313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:55.784130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ded53-b800-4ccc-bd58-8428e2d3db92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:55.784754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ded53-b800-4ccc-bd58-8428e2d3db92 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:55.785026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ded53-b800-4ccc-bd58-8428e2d3db92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:55.785287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ded53-b800-4ccc-bd58-8428e2d3db92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:55.785950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ded53-b800-4ccc-bd58-8428e2d3db92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:19:55.786243 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ded53-b800-4ccc-bd58-8428e2d3db92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:55.787276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-588ded53-b800-4ccc-bd58-8428e2d3db92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:19:55.787276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 16:19:55.787276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: Aug 17 16:19:55.788160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ded53-b800-4ccc-bd58-8428e2d3db92 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:55.799272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 755/1496] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:19:55.807633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bda28d-b5b3-443c-b621-e8aa3db206fe None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:55.817127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bda28d-b5b3-443c-b621-e8aa3db206fe None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:55.879322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:55.914281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987be60-6a2e-44c8-b48d-98a1278e6749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:55.914891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987be60-6a2e-44c8-b48d-98a1278e6749 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:55.915167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987be60-6a2e-44c8-b48d-98a1278e6749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:55.915433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987be60-6a2e-44c8-b48d-98a1278e6749 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:55.916423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987be60-6a2e-44c8-b48d-98a1278e6749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:55.918174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-7987be60-6a2e-44c8-b48d-98a1278e6749 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:19:55.918174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: warnings.warn(msg) Aug 17 16:19:55.918174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: Aug 17 16:19:55.919357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987be60-6a2e-44c8-b48d-98a1278e6749 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:56.026927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 742/1497] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:19:55 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:19:56.031269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ded53-b800-4ccc-bd58-8428e2d3db92 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:56.032941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-588ded53-b800-4ccc-bd58-8428e2d3db92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:56.066916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ded53-b800-4ccc-bd58-8428e2d3db92 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:56.158105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c576f-c415-4ad9-a555-00814dd195e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:56.158647 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c576f-c415-4ad9-a555-00814dd195e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:56.158924 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c576f-c415-4ad9-a555-00814dd195e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:56.159188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c576f-c415-4ad9-a555-00814dd195e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:56.159793 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c576f-c415-4ad9-a555-00814dd195e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:56.160839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-be5c576f-c415-4ad9-a555-00814dd195e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:19:56.160839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 16:19:56.160839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: Aug 17 16:19:56.162107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c576f-c415-4ad9-a555-00814dd195e0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:56.241838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 756/1498] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:19:56 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:19:56.246009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987be60-6a2e-44c8-b48d-98a1278e6749 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:56.247507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7987be60-6a2e-44c8-b48d-98a1278e6749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:56.309150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987be60-6a2e-44c8-b48d-98a1278e6749 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:56.393403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:56.403876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecee1b-4308-4d44-9b40-5820f6cdc2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:56.404499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecee1b-4308-4d44-9b40-5820f6cdc2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:56.404775 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecee1b-4308-4d44-9b40-5820f6cdc2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:56.405043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecee1b-4308-4d44-9b40-5820f6cdc2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:56.405715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecee1b-4308-4d44-9b40-5820f6cdc2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:56.406735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-a4ecee1b-4308-4d44-9b40-5820f6cdc2e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:19:56.406735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: warnings.warn(msg) Aug 17 16:19:56.406735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: Aug 17 16:19:56.407880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecee1b-4308-4d44-9b40-5820f6cdc2e2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:56.424230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 743/1499] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:19:56.425284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c576f-c415-4ad9-a555-00814dd195e0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:56.426888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-be5c576f-c415-4ad9-a555-00814dd195e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:56.439098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c576f-c415-4ad9-a555-00814dd195e0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:56.464102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:56.533191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546328b3-5bb1-428c-a015-4c0e6ab1c2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:56.533821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546328b3-5bb1-428c-a015-4c0e6ab1c2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:56.534098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546328b3-5bb1-428c-a015-4c0e6ab1c2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:56.534370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546328b3-5bb1-428c-a015-4c0e6ab1c2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:56.535003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546328b3-5bb1-428c-a015-4c0e6ab1c2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:56.536017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-546328b3-5bb1-428c-a015-4c0e6ab1c2d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:19:56.536017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 16:19:56.536017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: Aug 17 16:19:56.536990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546328b3-5bb1-428c-a015-4c0e6ab1c2d4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:56.551227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 757/1500] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:19:56.555520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecee1b-4308-4d44-9b40-5820f6cdc2e2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:56.557047 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a4ecee1b-4308-4d44-9b40-5820f6cdc2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:56.590579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecee1b-4308-4d44-9b40-5820f6cdc2e2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:56.686823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e215a32-995f-4296-998e-6f5739a8e8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:56.687399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215a32-995f-4296-998e-6f5739a8e8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:56.687674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215a32-995f-4296-998e-6f5739a8e8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:56.687941 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215a32-995f-4296-998e-6f5739a8e8a4 admin admin] PATH_INFO: `/v3/projects/d96d978f8a4f4209939e361a80efd17e/users/dfe4f7911ef04e919f6ee774c6637bb1/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:56.709358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e215a32-995f-4296-998e-6f5739a8e8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96d978f8a4f4209939e361a80efd17e, user_id=dfe4f7911ef04e919f6ee774c6637bb1, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:56.710408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-8e215a32-995f-4296-998e-6f5739a8e8a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:19:56.710408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: warnings.warn(msg) Aug 17 16:19:56.710408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: Aug 17 16:19:56.712344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e215a32-995f-4296-998e-6f5739a8e8a4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:56.818058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 744/1501] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:19:56 2022] PUT /identity/v3/projects/d96d978f8a4f4209939e361a80efd17e/users/dfe4f7911ef04e919f6ee774c6637bb1/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:19:56.830835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783868-a270-4ac2-acfe-3afd4c1e1188 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:56.831128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783868-a270-4ac2-acfe-3afd4c1e1188 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:56.831392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783868-a270-4ac2-acfe-3afd4c1e1188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:56.886441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b2783868-a270-4ac2-acfe-3afd4c1e1188 None None] MFA Rules not processed for user `dfe4f7911ef04e919f6ee774c6637bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:56.887644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b2783868-a270-4ac2-acfe-3afd4c1e1188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:56.964802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 758/1502] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:19:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:56.978521 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db312d2-3170-4c5a-8ea3-7452ef9e382b None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:56.978804 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db312d2-3170-4c5a-8ea3-7452ef9e382b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:56.979073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db312d2-3170-4c5a-8ea3-7452ef9e382b None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:56.980411 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 745/1503] 10.222.0.40 () {54 vars in 964 bytes} [Wed Aug 17 16:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:19:56.985397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261aeb4-5116-422a-8c10-f5dbce959f90 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:56.985707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261aeb4-5116-422a-8c10-f5dbce959f90 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:56.986054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261aeb4-5116-422a-8c10-f5dbce959f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:57.016953 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:57.060660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e261aeb4-5116-422a-8c10-f5dbce959f90 None None] MFA Rules not processed for user `4227da1895a94c9c845c4f7adf838144`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:57.061879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e261aeb4-5116-422a-8c10-f5dbce959f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:57.135727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 759/1504] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Aug 17 16:19:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:57.143936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db312d2-3170-4c5a-8ea3-7452ef9e382b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:57.145459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8db312d2-3170-4c5a-8ea3-7452ef9e382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:57.197081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:57.253261 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db312d2-3170-4c5a-8ea3-7452ef9e382b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:57.327252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b10d8c-e727-4dee-ab1f-a37c6ead823a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:57.327860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b10d8c-e727-4dee-ab1f-a37c6ead823a service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:57.328137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b10d8c-e727-4dee-ab1f-a37c6ead823a service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:57.328405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b10d8c-e727-4dee-ab1f-a37c6ead823a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:57.330839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-52b10d8c-e727-4dee-ab1f-a37c6ead823a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:57.435484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b10d8c-e727-4dee-ab1f-a37c6ead823a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:57.436936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b10d8c-e727-4dee-ab1f-a37c6ead823a service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:57.441353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:57.456514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 746/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:19:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:19:57.501916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8d11-783c-4cd4-aac7-25c68693f1ad None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:57.502343 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8d11-783c-4cd4-aac7-25c68693f1ad None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:57.502454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8d11-783c-4cd4-aac7-25c68693f1ad None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:57.503790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 760/1506] 10.222.0.40 () {52 vars in 830 bytes} [Wed Aug 17 16:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:19:57.507174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b10d8c-e727-4dee-ab1f-a37c6ead823a service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:57.508364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-52b10d8c-e727-4dee-ab1f-a37c6ead823a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:57.605996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b10d8c-e727-4dee-ab1f-a37c6ead823a service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:57.712265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:57.712900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:57.713180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:57.713655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] PATH_INFO: `/v3/users/dfe4f7911ef04e919f6ee774c6637bb1` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:57.726312 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe4f7911ef04e919f6ee774c6637bb1)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:57.727333 dv-cinder-852208-6-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:19:57.727333 dv-cinder-852208-6-smb devstack@keystone.service[81777]: warnings.warn(msg) Aug 17 16:19:57.727333 dv-cinder-852208-6-smb devstack@keystone.service[81777]: Aug 17 16:19:57.728543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:57.739080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:57.930059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe4f7911ef04e919f6ee774c6637bb1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.930591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe4f7911ef04e919f6ee774c6637bb1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.945067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe4f7911ef04e919f6ee774c6637bb1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.968063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe4f7911ef04e919f6ee774c6637bb1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:58.069620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe4f7911ef04e919f6ee774c6637bb1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:58.075398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 747/1507] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:19:57 2022] DELETE /identity/v3/users/dfe4f7911ef04e919f6ee774c6637bb1 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:19:58.079909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7410fa-274b-4d27-8f23-c4e2a575ee69 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:58.080188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7410fa-274b-4d27-8f23-c4e2a575ee69 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:58.080460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7410fa-274b-4d27-8f23-c4e2a575ee69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:58.137660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9d7410fa-274b-4d27-8f23-c4e2a575ee69 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:58.138848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9d7410fa-274b-4d27-8f23-c4e2a575ee69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:58.211326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:58.223952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 761/1508] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:58.233628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:58.234843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:58.336756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a476-dfc4-401f-a060-6b62fec35456 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:58.390644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:58.410554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590c2be-1097-4768-8ad3-6a44103bf8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:58.411184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590c2be-1097-4768-8ad3-6a44103bf8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:58.411458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590c2be-1097-4768-8ad3-6a44103bf8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:58.411726 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590c2be-1097-4768-8ad3-6a44103bf8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:58.413319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0590c2be-1097-4768-8ad3-6a44103bf8e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:58.522509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590c2be-1097-4768-8ad3-6a44103bf8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:58.523864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590c2be-1097-4768-8ad3-6a44103bf8e4 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:58.542541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 748/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:19:59.087863 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7410fa-274b-4d27-8f23-c4e2a575ee69 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:59.093775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9d7410fa-274b-4d27-8f23-c4e2a575ee69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:59.100746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7410fa-274b-4d27-8f23-c4e2a575ee69 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:59.199210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:59.199838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:59.200115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:59.200388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] PATH_INFO: `/v3/projects/d96d978f8a4f4209939e361a80efd17e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:59.210825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96d978f8a4f4209939e361a80efd17e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:59.211857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:19:59.211857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 16:19:59.211857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: Aug 17 16:19:59.213051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:59.329940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96d978f8a4f4209939e361a80efd17e', 'request_id': 'req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:59.336038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96d978f8a4f4209939e361a80efd17e', 'request_id': 'req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:59.348899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96d978f8a4f4209939e361a80efd17e', 'request_id': 'req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:59.445730 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] The token cache is being invalidate because project d96d978f8a4f4209939e361a80efd17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:19:59.446013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:59.446532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8ff40171-1fff-4b79-bb9a-a6634a5e7c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:59.447868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 762/1510] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:19:59 2022] DELETE /identity/v3/projects/d96d978f8a4f4209939e361a80efd17e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:20:08.540302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=62 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:09.443686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:32.431272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af2b3-300e-4fb8-b105-71d4de93bc6c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:32.431883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af2b3-300e-4fb8-b105-71d4de93bc6c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:32.431883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af2b3-300e-4fb8-b105-71d4de93bc6c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:32.433189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:21:32.438425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc99fd-1f1e-49fd-87d0-9a3324332a2c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:32.438875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc99fd-1f1e-49fd-87d0-9a3324332a2c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:32.438980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc99fd-1f1e-49fd-87d0-9a3324332a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:32.517349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-49dc99fd-1f1e-49fd-87d0-9a3324332a2c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:32.518692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-49dc99fd-1f1e-49fd-87d0-9a3324332a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:32.624982 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:32.780651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17af2b3-300e-4fb8-b105-71d4de93bc6c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:32.801965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b17af2b3-300e-4fb8-b105-71d4de93bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:32.904846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17af2b3-300e-4fb8-b105-71d4de93bc6c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:32.910507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66159d36-5183-4465-a795-1b9868908c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:32.911175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159d36-5183-4465-a795-1b9868908c7e service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:32.911459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159d36-5183-4465-a795-1b9868908c7e service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:32.911725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66159d36-5183-4465-a795-1b9868908c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:32.920226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66159d36-5183-4465-a795-1b9868908c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:32.921837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66159d36-5183-4465-a795-1b9868908c7e service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:32.930985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 750/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:33.762906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0c33-dbad-4beb-811b-3da77221a8da None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:33.763441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0c33-dbad-4beb-811b-3da77221a8da None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:33.763441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0c33-dbad-4beb-811b-3da77221a8da None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:33.764851 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:21:33.769842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a2e41-1b66-4c6f-91e6-831a47a163bc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:33.770240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a2e41-1b66-4c6f-91e6-831a47a163bc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:33.770413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a2e41-1b66-4c6f-91e6-831a47a163bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:33.789382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6f0a2e41-1b66-4c6f-91e6-831a47a163bc None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:33.790571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6f0a2e41-1b66-4c6f-91e6-831a47a163bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:33.799052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:33.951649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0c33-dbad-4beb-811b-3da77221a8da None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:33.966374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0c33-dbad-4beb-811b-3da77221a8da None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:33.971675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020bd92-0671-41b5-b8d4-1ad687de09bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:33.972272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020bd92-0671-41b5-b8d4-1ad687de09bd service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:33.972547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020bd92-0671-41b5-b8d4-1ad687de09bd service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:33.972818 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020bd92-0671-41b5-b8d4-1ad687de09bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:33.981612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020bd92-0671-41b5-b8d4-1ad687de09bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:33.983231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020bd92-0671-41b5-b8d4-1ad687de09bd service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:33.992516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 765/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:34.452122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9e202-cb12-4671-b541-91002b35aa48 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:34.452402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9e202-cb12-4671-b541-91002b35aa48 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:34.452669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9e202-cb12-4671-b541-91002b35aa48 None None] PATH_INFO: `/v3` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:34.453988 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 752/1517] 10.222.0.62 () {54 vars in 925 bytes} [Wed Aug 17 16:21:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:21:34.460835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f857b-601e-4e48-95ad-ddcab45ddd3b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:34.461120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f857b-601e-4e48-95ad-ddcab45ddd3b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:34.461417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f857b-601e-4e48-95ad-ddcab45ddd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:34.519614 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-983f857b-601e-4e48-95ad-ddcab45ddd3b None None] MFA Rules not processed for user `da5e1da2196b4ff399921809f40d3002`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:34.520809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-983f857b-601e-4e48-95ad-ddcab45ddd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:34.536984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:34.590354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 766/1518] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Aug 17 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:21:43.784752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=56 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:43.950494 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08f215-2a00-4c7c-b2ac-1640fc49b59e None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:43.950770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08f215-2a00-4c7c-b2ac-1640fc49b59e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:43.951043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08f215-2a00-4c7c-b2ac-1640fc49b59e None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:43.952427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 753/1519] 10.222.0.40 () {54 vars in 961 bytes} [Wed Aug 17 16:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:21:43.957508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece07fd0-4e8a-4fe9-8aa5-c8e74637b880 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:43.957969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece07fd0-4e8a-4fe9-8aa5-c8e74637b880 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:43.958085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece07fd0-4e8a-4fe9-8aa5-c8e74637b880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:43.977197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ece07fd0-4e8a-4fe9-8aa5-c8e74637b880 None None] MFA Rules not processed for user `da5e1da2196b4ff399921809f40d3002`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:43.978426 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ece07fd0-4e8a-4fe9-8aa5-c8e74637b880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:43.988231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 767/1520] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Aug 17 16:21:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:43.995769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08f215-2a00-4c7c-b2ac-1640fc49b59e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:44.009328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08f215-2a00-4c7c-b2ac-1640fc49b59e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:44.014824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f374d27-89eb-40e2-a6a7-c76556a96e9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da5e1da2196b4ff399921809f40d3002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:44.015410 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f374d27-89eb-40e2-a6a7-c76556a96e9c service placement] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:44.015682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f374d27-89eb-40e2-a6a7-c76556a96e9c service placement] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:44.015945 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f374d27-89eb-40e2-a6a7-c76556a96e9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:44.024159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f374d27-89eb-40e2-a6a7-c76556a96e9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:44.025815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f374d27-89eb-40e2-a6a7-c76556a96e9c service placement] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:44.036177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 754/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:45.221548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea240e2-14fb-4036-8ae0-4042aaf05e4f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:45.222094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea240e2-14fb-4036-8ae0-4042aaf05e4f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:45.222094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea240e2-14fb-4036-8ae0-4042aaf05e4f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:45.223444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:21:45.228146 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfc92-9c5d-46a9-a5d2-b5b3b47ac1e8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:45.228579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfc92-9c5d-46a9-a5d2-b5b3b47ac1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:45.228683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfc92-9c5d-46a9-a5d2-b5b3b47ac1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:45.248317 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c63dfc92-9c5d-46a9-a5d2-b5b3b47ac1e8 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:45.249547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c63dfc92-9c5d-46a9-a5d2-b5b3b47ac1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:45.257307 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:45.410763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea240e2-14fb-4036-8ae0-4042aaf05e4f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:45.425534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea240e2-14fb-4036-8ae0-4042aaf05e4f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:45.430784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73c6ca-bb9d-4875-a3cd-5a3a8d20c3df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:45.431371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73c6ca-bb9d-4875-a3cd-5a3a8d20c3df service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:45.432797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73c6ca-bb9d-4875-a3cd-5a3a8d20c3df service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:45.432797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73c6ca-bb9d-4875-a3cd-5a3a8d20c3df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:45.439819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73c6ca-bb9d-4875-a3cd-5a3a8d20c3df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:45.441408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73c6ca-bb9d-4875-a3cd-5a3a8d20c3df service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:45.450831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 769/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:46.269837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf985b-46cb-49c2-9d5e-5a32479fe913 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:46.270356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf985b-46cb-49c2-9d5e-5a32479fe913 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:46.270356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf985b-46cb-49c2-9d5e-5a32479fe913 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:46.271685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:21:46.276422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b141c-6993-47bc-a000-8ab477b2dd5d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:46.276845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b141c-6993-47bc-a000-8ab477b2dd5d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:46.277005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b141c-6993-47bc-a000-8ab477b2dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:46.296537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-720b141c-6993-47bc-a000-8ab477b2dd5d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:46.297743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-720b141c-6993-47bc-a000-8ab477b2dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:46.305580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:21:46.457864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf985b-46cb-49c2-9d5e-5a32479fe913 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:46.472068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf985b-46cb-49c2-9d5e-5a32479fe913 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:46.477330 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642db3c9-3f34-4cda-a850-d82f2648196f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:46.477941 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db3c9-3f34-4cda-a850-d82f2648196f service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:46.478212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db3c9-3f34-4cda-a850-d82f2648196f service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:46.478475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db3c9-3f34-4cda-a850-d82f2648196f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:46.486823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642db3c9-3f34-4cda-a850-d82f2648196f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:46.488385 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642db3c9-3f34-4cda-a850-d82f2648196f service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:46.498197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 757/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:50.477981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4cd96-2791-4c50-92cf-dad9fd2a6000 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:50.478546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4cd96-2791-4c50-92cf-dad9fd2a6000 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:50.478546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4cd96-2791-4c50-92cf-dad9fd2a6000 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:50.479906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:21:50.485644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260eac8-102e-4b0c-b79e-ee5784d02e76 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:50.486072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260eac8-102e-4b0c-b79e-ee5784d02e76 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:50.486180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260eac8-102e-4b0c-b79e-ee5784d02e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:50.505322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1260eac8-102e-4b0c-b79e-ee5784d02e76 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:50.506546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1260eac8-102e-4b0c-b79e-ee5784d02e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:50.514282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:50.802900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4cd96-2791-4c50-92cf-dad9fd2a6000 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:50.804608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d6c4cd96-2791-4c50-92cf-dad9fd2a6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:50.882852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4cd96-2791-4c50-92cf-dad9fd2a6000 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:50.886530 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae56ff-e04e-467e-b871-851586a9c8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:50.887398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae56ff-e04e-467e-b871-851586a9c8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:50.887681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae56ff-e04e-467e-b871-851586a9c8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:50.887955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae56ff-e04e-467e-b871-851586a9c8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:50.897130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae56ff-e04e-467e-b871-851586a9c8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:50.898602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae56ff-e04e-467e-b871-851586a9c8c1 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:50.908263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 772/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:52.795767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f521c-02dc-433a-bad0-4d29abbff015 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:52.796303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f521c-02dc-433a-bad0-4d29abbff015 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:52.796303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f521c-02dc-433a-bad0-4d29abbff015 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:52.797609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:21:52.802782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c5c0-2142-4fa1-adb6-8cd68bfad63e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:52.803229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c5c0-2142-4fa1-adb6-8cd68bfad63e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:52.803352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c5c0-2142-4fa1-adb6-8cd68bfad63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:52.823293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1334c5c0-2142-4fa1-adb6-8cd68bfad63e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:52.825151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1334c5c0-2142-4fa1-adb6-8cd68bfad63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:52.832892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:21:53.117388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f521c-02dc-433a-bad0-4d29abbff015 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:53.128959 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f521c-02dc-433a-bad0-4d29abbff015 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:53.132432 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0247774-ceee-4e99-b3bf-1899d5f086d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:53.133023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247774-ceee-4e99-b3bf-1899d5f086d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:53.133296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247774-ceee-4e99-b3bf-1899d5f086d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:53.133598 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247774-ceee-4e99-b3bf-1899d5f086d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:53.142437 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0247774-ceee-4e99-b3bf-1899d5f086d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:53.143841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0247774-ceee-4e99-b3bf-1899d5f086d2 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:53.153184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 760/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:56.769206 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0f66b-bf4a-40e4-95ca-dcc2712b1719 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:56.769816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0f66b-bf4a-40e4-95ca-dcc2712b1719 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:56.769816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0f66b-bf4a-40e4-95ca-dcc2712b1719 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:56.771063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:21:56.776065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f0108-aca4-4084-ab7a-148c8d433031 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:56.776498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f0108-aca4-4084-ab7a-148c8d433031 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:56.776611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f0108-aca4-4084-ab7a-148c8d433031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:56.796054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c14f0108-aca4-4084-ab7a-148c8d433031 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:56.797249 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c14f0108-aca4-4084-ab7a-148c8d433031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:56.805107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:57.347521 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0f66b-bf4a-40e4-95ca-dcc2712b1719 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:57.349273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-25d0f66b-bf4a-40e4-95ca-dcc2712b1719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:57.414251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:57.427756 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0f66b-bf4a-40e4-95ca-dcc2712b1719 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:57.431273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf4d98-fb83-43bf-bcfb-1d9513793fa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:57.431875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf4d98-fb83-43bf-bcfb-1d9513793fa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:57.432153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf4d98-fb83-43bf-bcfb-1d9513793fa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:57.432424 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf4d98-fb83-43bf-bcfb-1d9513793fa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:57.441808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf4d98-fb83-43bf-bcfb-1d9513793fa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:57.443245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf4d98-fb83-43bf-bcfb-1d9513793fa3 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:57.453075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 775/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:59.383401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e2ab9-5f9e-42aa-bac9-fd3cdf1e4859 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:59.383964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e2ab9-5f9e-42aa-bac9-fd3cdf1e4859 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:59.383964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e2ab9-5f9e-42aa-bac9-fd3cdf1e4859 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:59.385297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:21:59.391095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8d4cd-4b22-4c0f-9d7c-2039a7c9c15e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:59.391537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8d4cd-4b22-4c0f-9d7c-2039a7c9c15e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:59.391637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8d4cd-4b22-4c0f-9d7c-2039a7c9c15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:59.412152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-bae8d4cd-4b22-4c0f-9d7c-2039a7c9c15e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:59.413333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bae8d4cd-4b22-4c0f-9d7c-2039a7c9c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:59.421379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:59.972134 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e2ab9-5f9e-42aa-bac9-fd3cdf1e4859 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:59.973851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-462e2ab9-5f9e-42aa-bac9-fd3cdf1e4859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:59.987384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e2ab9-5f9e-42aa-bac9-fd3cdf1e4859 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:59.990879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a482115-49b9-4b06-98ea-fb3edb477014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:59.991469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a482115-49b9-4b06-98ea-fb3edb477014 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:59.991744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a482115-49b9-4b06-98ea-fb3edb477014 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:59.992018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a482115-49b9-4b06-98ea-fb3edb477014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:22:00.001513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a482115-49b9-4b06-98ea-fb3edb477014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:22:00.002934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a482115-49b9-4b06-98ea-fb3edb477014 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:22:00.012167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 763/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:22:09.407520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=11 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:10.008107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=33 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:27.266521 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa432e7-aac4-4a5d-bdfd-5f3afff72afe None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.270527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa432e7-aac4-4a5d-bdfd-5f3afff72afe None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.270527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa432e7-aac4-4a5d-bdfd-5f3afff72afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.294269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2aa432e7-aac4-4a5d-bdfd-5f3afff72afe None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.295503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2aa432e7-aac4-4a5d-bdfd-5f3afff72afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.307611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 777/1540] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:27.316534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f133c-0500-4bf0-9286-fc47e3e571b7 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.317141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f133c-0500-4bf0-9286-fc47e3e571b7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.317141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f133c-0500-4bf0-9286-fc47e3e571b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.352096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-727f133c-0500-4bf0-9286-fc47e3e571b7 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.353508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-727f133c-0500-4bf0-9286-fc47e3e571b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.365372 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 764/1541] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:27.365664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85d2c-28d1-4dbe-aab2-dab441297909 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.365937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85d2c-28d1-4dbe-aab2-dab441297909 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.366207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85d2c-28d1-4dbe-aab2-dab441297909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.374943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f133c-0500-4bf0-9286-fc47e3e571b7 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:27.385616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f133c-0500-4bf0-9286-fc47e3e571b7 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:27.396715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323e62-7596-452a-ac0b-c156705e9df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:27.397339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323e62-7596-452a-ac0b-c156705e9df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.397855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323e62-7596-452a-ac0b-c156705e9df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.398131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323e62-7596-452a-ac0b-c156705e9df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.398786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf323e62-7596-452a-ac0b-c156705e9df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:27.399086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf323e62-7596-452a-ac0b-c156705e9df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:27.400567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-bf323e62-7596-452a-ac0b-c156705e9df9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:23:27.400567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: warnings.warn(msg) Aug 17 16:23:27.400567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: Aug 17 16:23:27.401493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf323e62-7596-452a-ac0b-c156705e9df9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:27.404229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-31b85d2c-28d1-4dbe-aab2-dab441297909 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.405596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-31b85d2c-28d1-4dbe-aab2-dab441297909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.419058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 765/1542] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:23:27.420396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d547f5-288c-4cb9-a568-e667bcd39bd5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.420672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d547f5-288c-4cb9-a568-e667bcd39bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.420951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d547f5-288c-4cb9-a568-e667bcd39bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.422686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 778/1543] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:23:27.438415 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40455c-1fcb-4761-baac-a5ea8a3b95f6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.438741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40455c-1fcb-4761-baac-a5ea8a3b95f6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.438960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40455c-1fcb-4761-baac-a5ea8a3b95f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.458339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-13d547f5-288c-4cb9-a568-e667bcd39bd5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.459575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-13d547f5-288c-4cb9-a568-e667bcd39bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.484783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-af40455c-1fcb-4761-baac-a5ea8a3b95f6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.485735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 766/1544] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:27.486099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-af40455c-1fcb-4761-baac-a5ea8a3b95f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.486556 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d547f5-288c-4cb9-a568-e667bcd39bd5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:27.502083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d547f5-288c-4cb9-a568-e667bcd39bd5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:27.514661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 779/1545] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:27.515947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a88750-cff4-45ba-850a-6b074a5387e3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.516226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a88750-cff4-45ba-850a-6b074a5387e3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.516495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a88750-cff4-45ba-850a-6b074a5387e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.518833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f512b-3d03-4554-9a80-b3872023b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:27.519404 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f512b-3d03-4554-9a80-b3872023b67f admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.519789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f512b-3d03-4554-9a80-b3872023b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.520063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f512b-3d03-4554-9a80-b3872023b67f admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.520689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f512b-3d03-4554-9a80-b3872023b67f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:27.522941 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f512b-3d03-4554-9a80-b3872023b67f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:27.573557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-03a88750-cff4-45ba-850a-6b074a5387e3 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.574735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-03a88750-cff4-45ba-850a-6b074a5387e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.588767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 780/1546] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:27.590273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a88750-cff4-45ba-850a-6b074a5387e3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:27.600264 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a88750-cff4-45ba-850a-6b074a5387e3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:27.606118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1948ef-703f-4140-9211-be4d378aeddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:27.606730 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1948ef-703f-4140-9211-be4d378aeddd admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.607013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1948ef-703f-4140-9211-be4d378aeddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.607290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1948ef-703f-4140-9211-be4d378aeddd admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.607951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1948ef-703f-4140-9211-be4d378aeddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:27.608254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1948ef-703f-4140-9211-be4d378aeddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:27.610046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1948ef-703f-4140-9211-be4d378aeddd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:27.622629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 781/1547] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:27.624264 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39878-beea-4efb-a993-d0d70df4cff2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.624546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39878-beea-4efb-a993-d0d70df4cff2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.624858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39878-beea-4efb-a993-d0d70df4cff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.645493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-17b39878-beea-4efb-a993-d0d70df4cff2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.646682 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-17b39878-beea-4efb-a993-d0d70df4cff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.656130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 782/1548] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:27.657070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d8a14-eebe-416c-ab02-47b203413fdb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.657545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d8a14-eebe-416c-ab02-47b203413fdb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.657826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d8a14-eebe-416c-ab02-47b203413fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.678334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 767/1549] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:27.678562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8f6d8a14-eebe-416c-ab02-47b203413fdb None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.682990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8f6d8a14-eebe-416c-ab02-47b203413fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.683156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc802b-f753-477f-9d5c-409bbaa12533 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.683156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc802b-f753-477f-9d5c-409bbaa12533 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.683156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc802b-f753-477f-9d5c-409bbaa12533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.702003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6dfc802b-f753-477f-9d5c-409bbaa12533 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.703282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6dfc802b-f753-477f-9d5c-409bbaa12533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.744157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 783/1550] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:27.744998 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d8a14-eebe-416c-ab02-47b203413fdb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:27.754644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d8a14-eebe-416c-ab02-47b203413fdb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:27.761683 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8def3-bc2c-4ec7-b3d5-1eb5a52f0e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:27.766009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8def3-bc2c-4ec7-b3d5-1eb5a52f0e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.766009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8def3-bc2c-4ec7-b3d5-1eb5a52f0e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.766009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8def3-bc2c-4ec7-b3d5-1eb5a52f0e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.766009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8def3-bc2c-4ec7-b3d5-1eb5a52f0e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:27.766009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8def3-bc2c-4ec7-b3d5-1eb5a52f0e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:27.766009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8def3-bc2c-4ec7-b3d5-1eb5a52f0e07 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:27.776761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 768/1551] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:27.776761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2606-86d8-4314-94ed-4c1e37400ef3 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.776761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2606-86d8-4314-94ed-4c1e37400ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.776761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2606-86d8-4314-94ed-4c1e37400ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.782881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 784/1552] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:27.783662 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8def3-bc2c-4ec7-b3d5-1eb5a52f0e07 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:27.792303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4ade2606-86d8-4314-94ed-4c1e37400ef3 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.793616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4ade2606-86d8-4314-94ed-4c1e37400ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.799344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8def3-bc2c-4ec7-b3d5-1eb5a52f0e07 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:27.801647 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 769/1553] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:27.805590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23728c0-04e9-4d17-ae05-e18c1002602e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.805590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23728c0-04e9-4d17-ae05-e18c1002602e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.805590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23728c0-04e9-4d17-ae05-e18c1002602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.808751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b1e1-230e-409d-abed-ab6957e24d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:27.809381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b1e1-230e-409d-abed-ab6957e24d69 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.810156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b1e1-230e-409d-abed-ab6957e24d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.810437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b1e1-230e-409d-abed-ab6957e24d69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.811061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083b1e1-230e-409d-abed-ab6957e24d69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:27.812078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-c083b1e1-230e-409d-abed-ab6957e24d69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:23:27.812078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 16:23:27.812078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: Aug 17 16:23:27.813285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083b1e1-230e-409d-abed-ab6957e24d69 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:27.828749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c23728c0-04e9-4d17-ae05-e18c1002602e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.830016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c23728c0-04e9-4d17-ae05-e18c1002602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.839095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 770/1554] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:27.840857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099189f-09d8-46ae-bfa2-0f1ab92107c8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.840857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099189f-09d8-46ae-bfa2-0f1ab92107c8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.840857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099189f-09d8-46ae-bfa2-0f1ab92107c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.860912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a099189f-09d8-46ae-bfa2-0f1ab92107c8 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.862180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a099189f-09d8-46ae-bfa2-0f1ab92107c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.870526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 771/1555] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:27.871264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099189f-09d8-46ae-bfa2-0f1ab92107c8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:27.880311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099189f-09d8-46ae-bfa2-0f1ab92107c8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:27.885219 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90f494-db09-4680-a8aa-7df89d6ef0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:27.885838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f494-db09-4680-a8aa-7df89d6ef0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.886111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f494-db09-4680-a8aa-7df89d6ef0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.886377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f494-db09-4680-a8aa-7df89d6ef0d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.887032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90f494-db09-4680-a8aa-7df89d6ef0d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:27.888042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-4d90f494-db09-4680-a8aa-7df89d6ef0d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:23:27.888042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: warnings.warn(msg) Aug 17 16:23:27.888042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: Aug 17 16:23:27.889237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90f494-db09-4680-a8aa-7df89d6ef0d1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:27.929042 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 785/1556] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:27.930539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221742-051b-4b7e-8ce8-1636b6d98e1f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.931491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221742-051b-4b7e-8ce8-1636b6d98e1f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.931990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221742-051b-4b7e-8ce8-1636b6d98e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.951958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a6221742-051b-4b7e-8ce8-1636b6d98e1f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.953151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a6221742-051b-4b7e-8ce8-1636b6d98e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:27.968022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 772/1557] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:27.973970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866899dd-2d46-4765-b4a3-1d5936d466ae None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:27.973970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866899dd-2d46-4765-b4a3-1d5936d466ae None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:27.973970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866899dd-2d46-4765-b4a3-1d5936d466ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:27.989531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-866899dd-2d46-4765-b4a3-1d5936d466ae None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:27.990736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-866899dd-2d46-4765-b4a3-1d5936d466ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:28.014357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 786/1558] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:28.018584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6221742-051b-4b7e-8ce8-1636b6d98e1f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.027821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6221742-051b-4b7e-8ce8-1636b6d98e1f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.032263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77bd61-82c8-46d7-8bd0-86a4fa260995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.032854 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bd61-82c8-46d7-8bd0-86a4fa260995 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.033158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bd61-82c8-46d7-8bd0-86a4fa260995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.033585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bd61-82c8-46d7-8bd0-86a4fa260995 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.034205 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77bd61-82c8-46d7-8bd0-86a4fa260995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.036225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77bd61-82c8-46d7-8bd0-86a4fa260995 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.052593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 773/1559] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:28.057287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c89a-0397-4504-8bbe-5b974363bb5d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.057287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c89a-0397-4504-8bbe-5b974363bb5d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.057287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c89a-0397-4504-8bbe-5b974363bb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.068473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:28.074850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3ad7c89a-0397-4504-8bbe-5b974363bb5d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:28.076027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3ad7c89a-0397-4504-8bbe-5b974363bb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:28.083753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 774/1560] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:28.085093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9edd82-8698-464f-903f-806ce9c4554a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.085385 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9edd82-8698-464f-903f-806ce9c4554a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.085661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9edd82-8698-464f-903f-806ce9c4554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.104046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3f9edd82-8698-464f-903f-806ce9c4554a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:28.105192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3f9edd82-8698-464f-903f-806ce9c4554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:28.112752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 775/1561] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:28.113650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9edd82-8698-464f-903f-806ce9c4554a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.121699 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:28.123370 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9edd82-8698-464f-903f-806ce9c4554a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.127833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4ec2e-8767-4859-9315-a0fa3b451f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.128412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4ec2e-8767-4859-9315-a0fa3b451f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.128684 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4ec2e-8767-4859-9315-a0fa3b451f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.128789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 787/1562] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:28 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:28.129021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4ec2e-8767-4859-9315-a0fa3b451f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.129794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4ec2e-8767-4859-9315-a0fa3b451f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:28.130094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4ec2e-8767-4859-9315-a0fa3b451f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.131866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4ec2e-8767-4859-9315-a0fa3b451f9e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.132628 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77bd61-82c8-46d7-8bd0-86a4fa260995 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.152414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 776/1563] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:28.152414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4ec2e-8767-4859-9315-a0fa3b451f9e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.155695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4ec2e-8767-4859-9315-a0fa3b451f9e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.204854 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77bd61-82c8-46d7-8bd0-86a4fa260995 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.209725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359010e7-581d-41db-ab53-ff6d0026b467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.210336 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359010e7-581d-41db-ab53-ff6d0026b467 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.210653 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359010e7-581d-41db-ab53-ff6d0026b467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.210923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359010e7-581d-41db-ab53-ff6d0026b467 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.211547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359010e7-581d-41db-ab53-ff6d0026b467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.213503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd286799-7a14-4706-b8e9-7740cedbd6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.213964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359010e7-581d-41db-ab53-ff6d0026b467 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.214137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd286799-7a14-4706-b8e9-7740cedbd6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.214409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd286799-7a14-4706-b8e9-7740cedbd6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.214672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd286799-7a14-4706-b8e9-7740cedbd6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.215332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd286799-7a14-4706-b8e9-7740cedbd6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.216929 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd286799-7a14-4706-b8e9-7740cedbd6f4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.228380 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 777/1564] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:28.233907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd286799-7a14-4706-b8e9-7740cedbd6f4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.239138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd286799-7a14-4706-b8e9-7740cedbd6f4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.244212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40703ee-ab4a-49dd-bda4-01aac2bf4a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.244908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40703ee-ab4a-49dd-bda4-01aac2bf4a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.245177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40703ee-ab4a-49dd-bda4-01aac2bf4a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.245537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40703ee-ab4a-49dd-bda4-01aac2bf4a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.246159 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40703ee-ab4a-49dd-bda4-01aac2bf4a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:28.246451 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40703ee-ab4a-49dd-bda4-01aac2bf4a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.248008 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40703ee-ab4a-49dd-bda4-01aac2bf4a49 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.260412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 778/1565] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:28.262629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40703ee-ab4a-49dd-bda4-01aac2bf4a49 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.270645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40703ee-ab4a-49dd-bda4-01aac2bf4a49 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.275387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b0dbb-c594-4c6b-97a4-94d33f22e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.275941 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0dbb-c594-4c6b-97a4-94d33f22e5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.276216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0dbb-c594-4c6b-97a4-94d33f22e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.276478 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0dbb-c594-4c6b-97a4-94d33f22e5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.277083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0dbb-c594-4c6b-97a4-94d33f22e5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:28.277425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0dbb-c594-4c6b-97a4-94d33f22e5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.279006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0dbb-c594-4c6b-97a4-94d33f22e5e9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.290884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 779/1566] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:28.296391 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b0dbb-c594-4c6b-97a4-94d33f22e5e9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.301154 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b0dbb-c594-4c6b-97a4-94d33f22e5e9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.306488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefe9a1-e537-4b28-9acd-048bb561b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.307104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefe9a1-e537-4b28-9acd-048bb561b439 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.307379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefe9a1-e537-4b28-9acd-048bb561b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.307665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefe9a1-e537-4b28-9acd-048bb561b439 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.308282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefe9a1-e537-4b28-9acd-048bb561b439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:28.308643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefe9a1-e537-4b28-9acd-048bb561b439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.310245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefe9a1-e537-4b28-9acd-048bb561b439 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.323447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 788/1567] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:28 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:28.325111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 780/1568] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:28.325550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359010e7-581d-41db-ab53-ff6d0026b467 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.325671 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefe9a1-e537-4b28-9acd-048bb561b439 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.334288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359010e7-581d-41db-ab53-ff6d0026b467 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.335181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefe9a1-e537-4b28-9acd-048bb561b439 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.339294 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab22fb-7813-48a5-a134-25be7948a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.339990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab22fb-7813-48a5-a134-25be7948a77e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.340126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037844f9-6a19-47d5-9e41-a9c391dabd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.340256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab22fb-7813-48a5-a134-25be7948a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.340526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab22fb-7813-48a5-a134-25be7948a77e admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.340669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037844f9-6a19-47d5-9e41-a9c391dabd7c admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.340963 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037844f9-6a19-47d5-9e41-a9c391dabd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.341170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab22fb-7813-48a5-a134-25be7948a77e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:28.341274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037844f9-6a19-47d5-9e41-a9c391dabd7c admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.341499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab22fb-7813-48a5-a134-25be7948a77e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.341855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037844f9-6a19-47d5-9e41-a9c391dabd7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.343135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab22fb-7813-48a5-a134-25be7948a77e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.343841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037844f9-6a19-47d5-9e41-a9c391dabd7c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.356222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 789/1569] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:28.357951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab22fb-7813-48a5-a134-25be7948a77e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.367544 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab22fb-7813-48a5-a134-25be7948a77e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.373226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce3f06-ceac-4c24-b63a-2c48e0d85f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.373862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce3f06-ceac-4c24-b63a-2c48e0d85f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.374141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce3f06-ceac-4c24-b63a-2c48e0d85f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.374412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce3f06-ceac-4c24-b63a-2c48e0d85f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.375031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce3f06-ceac-4c24-b63a-2c48e0d85f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.376932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce3f06-ceac-4c24-b63a-2c48e0d85f2d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.430542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 781/1570] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:28 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:28.432044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037844f9-6a19-47d5-9e41-a9c391dabd7c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.441323 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037844f9-6a19-47d5-9e41-a9c391dabd7c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.445869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dfab4-b777-40eb-9fde-eb29c7325188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.446462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dfab4-b777-40eb-9fde-eb29c7325188 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.446761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dfab4-b777-40eb-9fde-eb29c7325188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.447032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dfab4-b777-40eb-9fde-eb29c7325188 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.447677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7dfab4-b777-40eb-9fde-eb29c7325188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.449257 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7dfab4-b777-40eb-9fde-eb29c7325188 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.459360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 782/1571] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:28.465579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dfab4-b777-40eb-9fde-eb29c7325188 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.465729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 790/1572] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:28 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:28.465729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce3f06-ceac-4c24-b63a-2c48e0d85f2d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.470783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dfab4-b777-40eb-9fde-eb29c7325188 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.526249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce3f06-ceac-4c24-b63a-2c48e0d85f2d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.528864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708be92-a803-4d9b-b0f7-73f94fdfde82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.529563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708be92-a803-4d9b-b0f7-73f94fdfde82 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.529817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708be92-a803-4d9b-b0f7-73f94fdfde82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.530087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708be92-a803-4d9b-b0f7-73f94fdfde82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.530700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708be92-a803-4d9b-b0f7-73f94fdfde82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.530905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523c63c-9561-4a02-a2fc-2f031e7b17d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.531502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c63c-9561-4a02-a2fc-2f031e7b17d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.531775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c63c-9561-4a02-a2fc-2f031e7b17d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.532043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c63c-9561-4a02-a2fc-2f031e7b17d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.532618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708be92-a803-4d9b-b0f7-73f94fdfde82 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.532723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523c63c-9561-4a02-a2fc-2f031e7b17d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.535022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523c63c-9561-4a02-a2fc-2f031e7b17d0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.548057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:28.613773 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 783/1573] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:28 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:28.614589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708be92-a803-4d9b-b0f7-73f94fdfde82 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.644685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 791/1574] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:28 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:28.644685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523c63c-9561-4a02-a2fc-2f031e7b17d0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.677210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708be92-a803-4d9b-b0f7-73f94fdfde82 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.685944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:28.707058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523c63c-9561-4a02-a2fc-2f031e7b17d0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.711746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997c62b-45f8-49cf-8aea-b78d5866801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.712484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997c62b-45f8-49cf-8aea-b78d5866801f admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.712765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997c62b-45f8-49cf-8aea-b78d5866801f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.713037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997c62b-45f8-49cf-8aea-b78d5866801f admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.713692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997c62b-45f8-49cf-8aea-b78d5866801f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.715617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997c62b-45f8-49cf-8aea-b78d5866801f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.734676 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454974-dd17-4b69-a137-bc8ebad8eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.739243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454974-dd17-4b69-a137-bc8ebad8eaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.739243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454974-dd17-4b69-a137-bc8ebad8eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.739243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454974-dd17-4b69-a137-bc8ebad8eaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.739243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8454974-dd17-4b69-a137-bc8ebad8eaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.739243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8454974-dd17-4b69-a137-bc8ebad8eaf3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.748362 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 784/1575] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:28.749128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454974-dd17-4b69-a137-bc8ebad8eaf3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.758719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454974-dd17-4b69-a137-bc8ebad8eaf3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.764160 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440ea35-7d53-44ba-aab6-6c62e9dbbc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.764751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440ea35-7d53-44ba-aab6-6c62e9dbbc79 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.765028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440ea35-7d53-44ba-aab6-6c62e9dbbc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.765298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440ea35-7d53-44ba-aab6-6c62e9dbbc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.765980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440ea35-7d53-44ba-aab6-6c62e9dbbc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.767861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440ea35-7d53-44ba-aab6-6c62e9dbbc79 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.810026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 792/1576] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:28 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:28.810910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997c62b-45f8-49cf-8aea-b78d5866801f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.860510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 785/1577] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:28 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:28.861447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440ea35-7d53-44ba-aab6-6c62e9dbbc79 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.875371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997c62b-45f8-49cf-8aea-b78d5866801f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.932545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062fd5e-e5df-43d4-a8eb-09c7533f4011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.933147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062fd5e-e5df-43d4-a8eb-09c7533f4011 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.933455 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062fd5e-e5df-43d4-a8eb-09c7533f4011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.933727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062fd5e-e5df-43d4-a8eb-09c7533f4011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.933836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440ea35-7d53-44ba-aab6-6c62e9dbbc79 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.934366 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062fd5e-e5df-43d4-a8eb-09c7533f4011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.935960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062fd5e-e5df-43d4-a8eb-09c7533f4011 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.938734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf173874-06cb-4e3a-a71f-b9d4a2e121b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.939145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173874-06cb-4e3a-a71f-b9d4a2e121b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.939419 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173874-06cb-4e3a-a71f-b9d4a2e121b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.939688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173874-06cb-4e3a-a71f-b9d4a2e121b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.940293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf173874-06cb-4e3a-a71f-b9d4a2e121b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.942234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf173874-06cb-4e3a-a71f-b9d4a2e121b9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:28.949431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 793/1578] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:28.949431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062fd5e-e5df-43d4-a8eb-09c7533f4011 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:28.957276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062fd5e-e5df-43d4-a8eb-09c7533f4011 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:28.961989 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f728a7-190f-4374-9bc5-51a0194f206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:28.962668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f728a7-190f-4374-9bc5-51a0194f206a admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:28.962992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f728a7-190f-4374-9bc5-51a0194f206a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:28.963263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f728a7-190f-4374-9bc5-51a0194f206a admin admin] PATH_INFO: `/v3/projects/2f9cd5aaf00d4baa9f55dd0a0060284b/users/5eccedcc85e34f88b2394d19d19538f4/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:28.977319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f728a7-190f-4374-9bc5-51a0194f206a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9cd5aaf00d4baa9f55dd0a0060284b, user_id=5eccedcc85e34f88b2394d19d19538f4, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:28.979143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-35f728a7-190f-4374-9bc5-51a0194f206a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:23:28.979143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 16:23:28.979143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: Aug 17 16:23:28.981060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f728a7-190f-4374-9bc5-51a0194f206a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.033531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 786/1579] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:28 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:29.033531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf173874-06cb-4e3a-a71f-b9d4a2e121b9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.037444 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:29.042263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf173874-06cb-4e3a-a71f-b9d4a2e121b9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.048142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 794/1580] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:28 2022] PUT /identity/v3/projects/2f9cd5aaf00d4baa9f55dd0a0060284b/users/5eccedcc85e34f88b2394d19d19538f4/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:29.048946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f728a7-190f-4374-9bc5-51a0194f206a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.094501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:29.101791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4aa70-a978-4d80-9569-1a811b5017ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.102400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4aa70-a978-4d80-9569-1a811b5017ea admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.102668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4aa70-a978-4d80-9569-1a811b5017ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.102960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4aa70-a978-4d80-9569-1a811b5017ea admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.103673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4aa70-a978-4d80-9569-1a811b5017ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.106081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4aa70-a978-4d80-9569-1a811b5017ea admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.111579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f728a7-190f-4374-9bc5-51a0194f206a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.116436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68831a0-60b5-4425-bc60-498a9d3e9357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.117042 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68831a0-60b5-4425-bc60-498a9d3e9357 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.117346 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68831a0-60b5-4425-bc60-498a9d3e9357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.117636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68831a0-60b5-4425-bc60-498a9d3e9357 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.118257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68831a0-60b5-4425-bc60-498a9d3e9357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.120401 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68831a0-60b5-4425-bc60-498a9d3e9357 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.190526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 787/1581] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:29 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:29.191379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4aa70-a978-4d80-9569-1a811b5017ea admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.201315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4aa70-a978-4d80-9569-1a811b5017ea admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.206505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107d8e3-9bac-43db-b1e7-fa8e5c9038c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.207086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d8e3-9bac-43db-b1e7-fa8e5c9038c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.207356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d8e3-9bac-43db-b1e7-fa8e5c9038c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.207618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d8e3-9bac-43db-b1e7-fa8e5c9038c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.208241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107d8e3-9bac-43db-b1e7-fa8e5c9038c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.209874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107d8e3-9bac-43db-b1e7-fa8e5c9038c8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.223749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 788/1582] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.223749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107d8e3-9bac-43db-b1e7-fa8e5c9038c8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.225802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 795/1583] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:29 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:29.226619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68831a0-60b5-4425-bc60-498a9d3e9357 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.231696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107d8e3-9bac-43db-b1e7-fa8e5c9038c8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.236645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb13efa-04f1-46e5-bbd2-4721a58076a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.236809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68831a0-60b5-4425-bc60-498a9d3e9357 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.237239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb13efa-04f1-46e5-bbd2-4721a58076a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.237539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb13efa-04f1-46e5-bbd2-4721a58076a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.237806 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb13efa-04f1-46e5-bbd2-4721a58076a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.238411 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb13efa-04f1-46e5-bbd2-4721a58076a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.240387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb13efa-04f1-46e5-bbd2-4721a58076a4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.241466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45389f20-9d88-464e-bbb8-e4355641262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.242075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45389f20-9d88-464e-bbb8-e4355641262a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.242354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45389f20-9d88-464e-bbb8-e4355641262a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.242625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45389f20-9d88-464e-bbb8-e4355641262a admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.243252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45389f20-9d88-464e-bbb8-e4355641262a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.245319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45389f20-9d88-464e-bbb8-e4355641262a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.328030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 789/1584] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:29 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:29.329018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb13efa-04f1-46e5-bbd2-4721a58076a4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.340316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 796/1585] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:29 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:29.343029 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb13efa-04f1-46e5-bbd2-4721a58076a4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.343143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45389f20-9d88-464e-bbb8-e4355641262a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.346434 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856552cc-e035-429f-91fd-5e8a18a27498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.346986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856552cc-e035-429f-91fd-5e8a18a27498 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.347248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856552cc-e035-429f-91fd-5e8a18a27498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.347515 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856552cc-e035-429f-91fd-5e8a18a27498 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.348148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856552cc-e035-429f-91fd-5e8a18a27498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.349806 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856552cc-e035-429f-91fd-5e8a18a27498 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.349971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45389f20-9d88-464e-bbb8-e4355641262a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.355567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf19f80-4207-4090-b084-5502b1f04181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.356167 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf19f80-4207-4090-b084-5502b1f04181 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.356447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf19f80-4207-4090-b084-5502b1f04181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.356716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf19f80-4207-4090-b084-5502b1f04181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.357356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf19f80-4207-4090-b084-5502b1f04181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.359019 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf19f80-4207-4090-b084-5502b1f04181 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.362581 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 790/1586] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.363829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667a439-6faa-46c6-afd1-05603c8cffcd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.364115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667a439-6faa-46c6-afd1-05603c8cffcd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.364386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667a439-6faa-46c6-afd1-05603c8cffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.371608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 797/1587] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.372442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf19f80-4207-4090-b084-5502b1f04181 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.382048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf19f80-4207-4090-b084-5502b1f04181 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.387359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb959d3d-0c37-408f-bc6d-9f67eb855988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.387954 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959d3d-0c37-408f-bc6d-9f67eb855988 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.388230 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959d3d-0c37-408f-bc6d-9f67eb855988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.388498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959d3d-0c37-408f-bc6d-9f67eb855988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.389155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb959d3d-0c37-408f-bc6d-9f67eb855988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.390824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb959d3d-0c37-408f-bc6d-9f67eb855988 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.395055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6667a439-6faa-46c6-afd1-05603c8cffcd None None] MFA Rules not processed for user `5eccedcc85e34f88b2394d19d19538f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:29.396274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6667a439-6faa-46c6-afd1-05603c8cffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:29.403665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 798/1588] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.403665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb959d3d-0c37-408f-bc6d-9f67eb855988 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.413770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb959d3d-0c37-408f-bc6d-9f67eb855988 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.418750 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210125b-116f-4a27-820e-642b2c88ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.419387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210125b-116f-4a27-820e-642b2c88ea44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.419661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210125b-116f-4a27-820e-642b2c88ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.419931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210125b-116f-4a27-820e-642b2c88ea44 admin admin] PATH_INFO: `/v3/projects/ffbee49086ca4361a23040ce60c10c68/users/b9d6d909e5e24923bbfc53fcf9975425/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.434994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210125b-116f-4a27-820e-642b2c88ea44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbee49086ca4361a23040ce60c10c68, user_id=b9d6d909e5e24923bbfc53fcf9975425, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.437664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210125b-116f-4a27-820e-642b2c88ea44 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.460694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 791/1589] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:29.461563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667a439-6faa-46c6-afd1-05603c8cffcd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.471486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667a439-6faa-46c6-afd1-05603c8cffcd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.475932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7232ec2-cfa9-4ff8-ba5a-6a871906cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.476506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7232ec2-cfa9-4ff8-ba5a-6a871906cc51 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.476781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7232ec2-cfa9-4ff8-ba5a-6a871906cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.477048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7232ec2-cfa9-4ff8-ba5a-6a871906cc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.477716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7232ec2-cfa9-4ff8-ba5a-6a871906cc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.479546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7232ec2-cfa9-4ff8-ba5a-6a871906cc51 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.489148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 792/1590] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.489937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7232ec2-cfa9-4ff8-ba5a-6a871906cc51 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.499470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7232ec2-cfa9-4ff8-ba5a-6a871906cc51 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.503968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e51a69-9da3-4eee-a5b8-433cbf380ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.504517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e51a69-9da3-4eee-a5b8-433cbf380ffb admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.504807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e51a69-9da3-4eee-a5b8-433cbf380ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.505112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e51a69-9da3-4eee-a5b8-433cbf380ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.505748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e51a69-9da3-4eee-a5b8-433cbf380ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.507260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e51a69-9da3-4eee-a5b8-433cbf380ffb admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.517282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 793/1591] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.518057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e51a69-9da3-4eee-a5b8-433cbf380ffb admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.527627 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 799/1592] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:29 2022] PUT /identity/v3/projects/ffbee49086ca4361a23040ce60c10c68/users/b9d6d909e5e24923bbfc53fcf9975425/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:29.528440 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210125b-116f-4a27-820e-642b2c88ea44 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.528821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e51a69-9da3-4eee-a5b8-433cbf380ffb admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.548428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:29.591510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe506a-fecb-4317-a3e2-d2787db4e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.592125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe506a-fecb-4317-a3e2-d2787db4e5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.592402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe506a-fecb-4317-a3e2-d2787db4e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.592671 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe506a-fecb-4317-a3e2-d2787db4e5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.593150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210125b-116f-4a27-820e-642b2c88ea44 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.593307 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe506a-fecb-4317-a3e2-d2787db4e5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.595106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe506a-fecb-4317-a3e2-d2787db4e5e5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.597926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070bcc-5b2a-46a4-b00a-78d41e9fe45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.598525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070bcc-5b2a-46a4-b00a-78d41e9fe45a admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.598798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070bcc-5b2a-46a4-b00a-78d41e9fe45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.599068 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070bcc-5b2a-46a4-b00a-78d41e9fe45a admin admin] PATH_INFO: `/v3/projects/845556f2bf394dfe89bddf4be51b2336/users/58d8aba7074e4a07b0e93107ea0b75cc/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.606195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 794/1593] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.606899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe506a-fecb-4317-a3e2-d2787db4e5e5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.615860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64070bcc-5b2a-46a4-b00a-78d41e9fe45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=845556f2bf394dfe89bddf4be51b2336, user_id=58d8aba7074e4a07b0e93107ea0b75cc, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.616332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe506a-fecb-4317-a3e2-d2787db4e5e5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.618529 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64070bcc-5b2a-46a4-b00a-78d41e9fe45a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.621739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648b62b-b52e-4b21-943e-0d1a6fa653e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.622327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648b62b-b52e-4b21-943e-0d1a6fa653e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.622606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648b62b-b52e-4b21-943e-0d1a6fa653e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.622881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648b62b-b52e-4b21-943e-0d1a6fa653e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.623504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648b62b-b52e-4b21-943e-0d1a6fa653e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.625077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648b62b-b52e-4b21-943e-0d1a6fa653e1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.635709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 795/1594] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.636626 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648b62b-b52e-4b21-943e-0d1a6fa653e1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.645899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648b62b-b52e-4b21-943e-0d1a6fa653e1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.650520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbf4b8-156f-446f-a9d0-428444a9daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.651261 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbf4b8-156f-446f-a9d0-428444a9daf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.651542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbf4b8-156f-446f-a9d0-428444a9daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.651826 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbf4b8-156f-446f-a9d0-428444a9daf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.652431 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbf4b8-156f-446f-a9d0-428444a9daf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.654020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbf4b8-156f-446f-a9d0-428444a9daf4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.664586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 796/1595] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.665327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbf4b8-156f-446f-a9d0-428444a9daf4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.675129 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbf4b8-156f-446f-a9d0-428444a9daf4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.679654 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9f384-b523-478f-8c2f-9e726a49bddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.680203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9f384-b523-478f-8c2f-9e726a49bddc admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.680537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9f384-b523-478f-8c2f-9e726a49bddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.680747 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9f384-b523-478f-8c2f-9e726a49bddc admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.681336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9f384-b523-478f-8c2f-9e726a49bddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.683886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9f384-b523-478f-8c2f-9e726a49bddc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.710454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 800/1596] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:29 2022] PUT /identity/v3/projects/845556f2bf394dfe89bddf4be51b2336/users/58d8aba7074e4a07b0e93107ea0b75cc/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:29.711284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070bcc-5b2a-46a4-b00a-78d41e9fe45a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.757706 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 797/1597] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:29 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:29.758476 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9f384-b523-478f-8c2f-9e726a49bddc admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.766860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:29.778663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070bcc-5b2a-46a4-b00a-78d41e9fe45a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.821277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9f384-b523-478f-8c2f-9e726a49bddc admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.826839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fdfac-f242-4b15-b7be-38b48b96f957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.827503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fdfac-f242-4b15-b7be-38b48b96f957 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.827849 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fdfac-f242-4b15-b7be-38b48b96f957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.828187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fdfac-f242-4b15-b7be-38b48b96f957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.828994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fdfac-f242-4b15-b7be-38b48b96f957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.830693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fdfac-f242-4b15-b7be-38b48b96f957 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.836620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b53fd-3099-411b-bfa2-0ae34e0bfeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.840136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b53fd-3099-411b-bfa2-0ae34e0bfeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.840136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b53fd-3099-411b-bfa2-0ae34e0bfeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.840136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b53fd-3099-411b-bfa2-0ae34e0bfeb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.840136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b53fd-3099-411b-bfa2-0ae34e0bfeb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.841225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b53fd-3099-411b-bfa2-0ae34e0bfeb7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.841740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 798/1598] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.843014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2228c80-69d0-4d71-84ca-20cc290c02f0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.843297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2228c80-69d0-4d71-84ca-20cc290c02f0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.843567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2228c80-69d0-4d71-84ca-20cc290c02f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.857598 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 801/1599] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.857598 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b53fd-3099-411b-bfa2-0ae34e0bfeb7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.863399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d2228c80-69d0-4d71-84ca-20cc290c02f0 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:29.864641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d2228c80-69d0-4d71-84ca-20cc290c02f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:29.865673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b53fd-3099-411b-bfa2-0ae34e0bfeb7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.870511 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d525b-bae4-4e33-a0d2-d88f783ec759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.871263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d525b-bae4-4e33-a0d2-d88f783ec759 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.871657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d525b-bae4-4e33-a0d2-d88f783ec759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.872024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d525b-bae4-4e33-a0d2-d88f783ec759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.872766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d525b-bae4-4e33-a0d2-d88f783ec759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.872935 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 799/1600] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:29.875096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d525b-bae4-4e33-a0d2-d88f783ec759 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.877032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2228c80-69d0-4d71-84ca-20cc290c02f0 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.887364 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 802/1601] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:29.888766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d525b-bae4-4e33-a0d2-d88f783ec759 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:29.890680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2228c80-69d0-4d71-84ca-20cc290c02f0 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.895431 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467dd43-c76c-4013-ad7a-46d6a5e4bc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.896239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467dd43-c76c-4013-ad7a-46d6a5e4bc1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.896523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467dd43-c76c-4013-ad7a-46d6a5e4bc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.896796 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467dd43-c76c-4013-ad7a-46d6a5e4bc1f admin admin] PATH_INFO: `/v3/projects/fa099c8716e242069bb76ded83795b54/users/7c0102d91c2a4366ab207651cee40321/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.899444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d525b-bae4-4e33-a0d2-d88f783ec759 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:29.905086 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7c583-e44d-4e77-964e-6bb498575a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:29.905779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c583-e44d-4e77-964e-6bb498575a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.906058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c583-e44d-4e77-964e-6bb498575a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.906327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c583-e44d-4e77-964e-6bb498575a72 admin admin] PATH_INFO: `/v3/projects/02623f56e00a49869c562ce98f0cd39b/users/22c7c123b98b45cf8182ce553b0be9fe/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:29.913829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467dd43-c76c-4013-ad7a-46d6a5e4bc1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa099c8716e242069bb76ded83795b54, user_id=7c0102d91c2a4366ab207651cee40321, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.916287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467dd43-c76c-4013-ad7a-46d6a5e4bc1f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.922674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7c583-e44d-4e77-964e-6bb498575a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02623f56e00a49869c562ce98f0cd39b, user_id=22c7c123b98b45cf8182ce553b0be9fe, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:29.925297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7c583-e44d-4e77-964e-6bb498575a72 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:29.984397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 800/1602] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:29 2022] PUT /identity/v3/projects/fa099c8716e242069bb76ded83795b54/users/7c0102d91c2a4366ab207651cee40321/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:29.985717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66d26-41fb-4152-8fb0-0d0a58074c84 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:29.989506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66d26-41fb-4152-8fb0-0d0a58074c84 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:29.989506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66d26-41fb-4152-8fb0-0d0a58074c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.005526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d7d66d26-41fb-4152-8fb0-0d0a58074c84 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:30.007120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d7d66d26-41fb-4152-8fb0-0d0a58074c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:30.014295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 803/1603] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:29 2022] PUT /identity/v3/projects/02623f56e00a49869c562ce98f0cd39b/users/22c7c123b98b45cf8182ce553b0be9fe/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:30.015061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7c583-e44d-4e77-964e-6bb498575a72 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:30.045399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:30.070915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 801/1604] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:30.071878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d66d26-41fb-4152-8fb0-0d0a58074c84 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:30.080286 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7c583-e44d-4e77-964e-6bb498575a72 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:30.082119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d66d26-41fb-4152-8fb0-0d0a58074c84 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:30.085161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6363a-c076-4b3c-99a7-ee8bbde4d798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:30.085812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6363a-c076-4b3c-99a7-ee8bbde4d798 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.086092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6363a-c076-4b3c-99a7-ee8bbde4d798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.086485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6363a-c076-4b3c-99a7-ee8bbde4d798 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.086657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a2d0f-a5ec-4523-a429-e4b789b467b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:30.087106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6363a-c076-4b3c-99a7-ee8bbde4d798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:30.087313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a2d0f-a5ec-4523-a429-e4b789b467b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.087593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a2d0f-a5ec-4523-a429-e4b789b467b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.087865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a2d0f-a5ec-4523-a429-e4b789b467b5 admin admin] PATH_INFO: `/v3/projects/3221414681654b5f99c26828d9ff57dc/users/bae20451f7774444a39c838589c82810/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.089444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6363a-c076-4b3c-99a7-ee8bbde4d798 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:30.103541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a2d0f-a5ec-4523-a429-e4b789b467b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3221414681654b5f99c26828d9ff57dc, user_id=bae20451f7774444a39c838589c82810, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:30.107281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a2d0f-a5ec-4523-a429-e4b789b467b5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:30.196509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 804/1605] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:30 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:30.198072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6363a-c076-4b3c-99a7-ee8bbde4d798 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:30.208003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6363a-c076-4b3c-99a7-ee8bbde4d798 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:30.212755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83196f93-32c0-4d2f-804c-ed849a94ab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:30.213457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83196f93-32c0-4d2f-804c-ed849a94ab66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.213736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83196f93-32c0-4d2f-804c-ed849a94ab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.214016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83196f93-32c0-4d2f-804c-ed849a94ab66 admin admin] PATH_INFO: `/v3/projects/9955166581814652b73ce7fbc377d025/users/7b92f9048d654e4787d036f6adbd840b/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.229703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83196f93-32c0-4d2f-804c-ed849a94ab66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9955166581814652b73ce7fbc377d025, user_id=7b92f9048d654e4787d036f6adbd840b, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:30.231211 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 802/1606] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:30 2022] PUT /identity/v3/projects/3221414681654b5f99c26828d9ff57dc/users/bae20451f7774444a39c838589c82810/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:30.239065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a2d0f-a5ec-4523-a429-e4b789b467b5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:30.239197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83196f93-32c0-4d2f-804c-ed849a94ab66 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:30.295804 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a2d0f-a5ec-4523-a429-e4b789b467b5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:30.299489 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7212a8-4a37-4474-9c17-299bc7ea9839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:30.300086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7212a8-4a37-4474-9c17-299bc7ea9839 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.300358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7212a8-4a37-4474-9c17-299bc7ea9839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.300624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7212a8-4a37-4474-9c17-299bc7ea9839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.333068 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 805/1607] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:30 2022] PUT /identity/v3/projects/9955166581814652b73ce7fbc377d025/users/7b92f9048d654e4787d036f6adbd840b/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:30.336937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83196f93-32c0-4d2f-804c-ed849a94ab66 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:30.363000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:30.365311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7212a8-4a37-4474-9c17-299bc7ea9839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:30.366921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7212a8-4a37-4474-9c17-299bc7ea9839 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:30.376634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 803/1608] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:30.378119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7ca5e-64ba-4e79-bec4-eb479f6e3b4d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.378226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7ca5e-64ba-4e79-bec4-eb479f6e3b4d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.378488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7ca5e-64ba-4e79-bec4-eb479f6e3b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.398955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83196f93-32c0-4d2f-804c-ed849a94ab66 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:30.404656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a8fef-3fc0-47af-b82a-5945deb7813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:30.405327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a8fef-3fc0-47af-b82a-5945deb7813c admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.405633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a8fef-3fc0-47af-b82a-5945deb7813c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.405904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a8fef-3fc0-47af-b82a-5945deb7813c admin admin] PATH_INFO: `/v3/projects/0642f4a1afc44559829ea45dd48f0d09/users/cf3ff8a4269a4dd0a53387f60d60a613/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.411509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a3a7ca5e-64ba-4e79-bec4-eb479f6e3b4d None None] MFA Rules not processed for user `7c0102d91c2a4366ab207651cee40321`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:30.413602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a3a7ca5e-64ba-4e79-bec4-eb479f6e3b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:30.421889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a8fef-3fc0-47af-b82a-5945deb7813c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0642f4a1afc44559829ea45dd48f0d09, user_id=cf3ff8a4269a4dd0a53387f60d60a613, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:30.425785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a8fef-3fc0-47af-b82a-5945deb7813c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:30.471187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:30.481404 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 804/1609] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:30.481404 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8782-e8a6-4d7b-abb0-551d95cb44c9 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.481404 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8782-e8a6-4d7b-abb0-551d95cb44c9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.483524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8782-e8a6-4d7b-abb0-551d95cb44c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.495010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 806/1610] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:30 2022] PUT /identity/v3/projects/0642f4a1afc44559829ea45dd48f0d09/users/cf3ff8a4269a4dd0a53387f60d60a613/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:30.496191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a8fef-3fc0-47af-b82a-5945deb7813c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:30.505239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-848e8782-e8a6-4d7b-abb0-551d95cb44c9 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:30.505239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-848e8782-e8a6-4d7b-abb0-551d95cb44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:30.573022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a8fef-3fc0-47af-b82a-5945deb7813c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:30.576945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626315f-c797-469d-8376-351df31e1b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:30.577807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626315f-c797-469d-8376-351df31e1b31 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.578091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626315f-c797-469d-8376-351df31e1b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.578368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626315f-c797-469d-8376-351df31e1b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.578610 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 805/1611] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:30.579680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8782-e8a6-4d7b-abb0-551d95cb44c9 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:30.590692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8782-e8a6-4d7b-abb0-551d95cb44c9 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:30.595909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626315f-c797-469d-8376-351df31e1b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:30.596062 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b31b99-4963-4175-a396-87b8efe96077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:30.596626 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b31b99-4963-4175-a396-87b8efe96077 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.596903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b31b99-4963-4175-a396-87b8efe96077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.597175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b31b99-4963-4175-a396-87b8efe96077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.597404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626315f-c797-469d-8376-351df31e1b31 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:30.597851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b31b99-4963-4175-a396-87b8efe96077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:30.599444 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b31b99-4963-4175-a396-87b8efe96077 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:30.607789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 807/1612] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:30.609095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee86b-3586-4c8e-b9cc-a19b98ec57c9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.609510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee86b-3586-4c8e-b9cc-a19b98ec57c9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.609789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee86b-3586-4c8e-b9cc-a19b98ec57c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.610238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 806/1613] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:30.611371 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecea54-3e58-4dd2-ba81-e763cebb0650 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.611662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecea54-3e58-4dd2-ba81-e763cebb0650 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.611986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecea54-3e58-4dd2-ba81-e763cebb0650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.631076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-93ecea54-3e58-4dd2-ba81-e763cebb0650 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:30.632295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-93ecea54-3e58-4dd2-ba81-e763cebb0650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:30.641287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 807/1614] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:30.641478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-35bee86b-3586-4c8e-b9cc-a19b98ec57c9 None None] MFA Rules not processed for user `bae20451f7774444a39c838589c82810`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:30.642367 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b34f2-1dd2-4f79-b1ef-77cb5c1e5ed8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.642645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b34f2-1dd2-4f79-b1ef-77cb5c1e5ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.642913 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b34f2-1dd2-4f79-b1ef-77cb5c1e5ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.643064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-35bee86b-3586-4c8e-b9cc-a19b98ec57c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:30.677021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-0a3b34f2-1dd2-4f79-b1ef-77cb5c1e5ed8 None None] MFA Rules not processed for user `cf3ff8a4269a4dd0a53387f60d60a613`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:30.678667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0a3b34f2-1dd2-4f79-b1ef-77cb5c1e5ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:30.726455 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 808/1615] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:30.732719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323c4f-f5a1-4ac0-82fb-80e42af3272d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.733127 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323c4f-f5a1-4ac0-82fb-80e42af3272d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.733652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323c4f-f5a1-4ac0-82fb-80e42af3272d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.753114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 809/1616] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 17 16:23:30 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:23:30.754346 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323c4f-f5a1-4ac0-82fb-80e42af3272d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:30.759554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-62323c4f-f5a1-4ac0-82fb-80e42af3272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:30.761590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 808/1617] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:30.762781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b34f2-1dd2-4f79-b1ef-77cb5c1e5ed8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:30.775579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b34f2-1dd2-4f79-b1ef-77cb5c1e5ed8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:30.781018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323c4f-f5a1-4ac0-82fb-80e42af3272d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:30.781893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bfae3-34ed-4309-8868-5a6f514e090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:30.782642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bfae3-34ed-4309-8868-5a6f514e090b admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.782996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bfae3-34ed-4309-8868-5a6f514e090b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.783365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bfae3-34ed-4309-8868-5a6f514e090b admin admin] PATH_INFO: `/v3/projects/935b40f1587342a29ef02ee06443fea3/users/00d3345dab98484cb19ec2353c1a6166/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.786250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b655bc-514e-4c0c-8ea1-760abcba586d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:30.787049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b655bc-514e-4c0c-8ea1-760abcba586d service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.787324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b655bc-514e-4c0c-8ea1-760abcba586d service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.787696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b655bc-514e-4c0c-8ea1-760abcba586d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.798972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b655bc-514e-4c0c-8ea1-760abcba586d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:30.800713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b655bc-514e-4c0c-8ea1-760abcba586d service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:30.802186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bfae3-34ed-4309-8868-5a6f514e090b admin admin] RBAC: Authorizing `identity:create_grant(project_id=935b40f1587342a29ef02ee06443fea3, user_id=00d3345dab98484cb19ec2353c1a6166, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:30.804954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bfae3-34ed-4309-8868-5a6f514e090b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:30.812585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 810/1618] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:30.813447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b655bc-514e-4c0c-8ea1-760abcba586d service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:30.822359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b655bc-514e-4c0c-8ea1-760abcba586d service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:30.827538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07feea-309c-45f7-9c05-999f191c1104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:30.827850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07feea-309c-45f7-9c05-999f191c1104 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.828171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07feea-309c-45f7-9c05-999f191c1104 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.828446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07feea-309c-45f7-9c05-999f191c1104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.839644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07feea-309c-45f7-9c05-999f191c1104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:30.841100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07feea-309c-45f7-9c05-999f191c1104 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:30.850952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 811/1619] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:30.855547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a7677-8b20-41f6-bc1e-21d251112a6a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.855837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a7677-8b20-41f6-bc1e-21d251112a6a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.856113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a7677-8b20-41f6-bc1e-21d251112a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.885887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:30.894764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 809/1620] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:30 2022] PUT /identity/v3/projects/935b40f1587342a29ef02ee06443fea3/users/00d3345dab98484cb19ec2353c1a6166/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:30.899417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801be91-a527-4b3a-a86a-4140369005c1 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.899417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801be91-a527-4b3a-a86a-4140369005c1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.899417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801be91-a527-4b3a-a86a-4140369005c1 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.899417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 810/1621] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 17 16:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:23:30.899417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801be91-a527-4b3a-a86a-4140369005c1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:30.915749 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0f6a7677-8b20-41f6-bc1e-21d251112a6a None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:30.918299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0f6a7677-8b20-41f6-bc1e-21d251112a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:30.954375 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:30.973656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801be91-a527-4b3a-a86a-4140369005c1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:30.979480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c76a9-b448-4a30-b189-37c1fef791b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:30.980150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c76a9-b448-4a30-b189-37c1fef791b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:30.980531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c76a9-b448-4a30-b189-37c1fef791b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:30.980922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c76a9-b448-4a30-b189-37c1fef791b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:30.981700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c76a9-b448-4a30-b189-37c1fef791b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:30.983758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c76a9-b448-4a30-b189-37c1fef791b6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:31.018636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 812/1622] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 17 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:31.019594 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a7677-8b20-41f6-bc1e-21d251112a6a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:31.030257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a7677-8b20-41f6-bc1e-21d251112a6a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:31.037730 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129455f9-f1e6-4d33-b946-264d08a26e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:31.039053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129455f9-f1e6-4d33-b946-264d08a26e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.039053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129455f9-f1e6-4d33-b946-264d08a26e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.039517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129455f9-f1e6-4d33-b946-264d08a26e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.040441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129455f9-f1e6-4d33-b946-264d08a26e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:31.042673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129455f9-f1e6-4d33-b946-264d08a26e8d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:31.057557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 813/1623] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:31.060147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260736-cccc-4d1a-a236-38a1f58831b1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.060606 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260736-cccc-4d1a-a236-38a1f58831b1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.060887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260736-cccc-4d1a-a236-38a1f58831b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.081770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-37260736-cccc-4d1a-a236-38a1f58831b1 None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:31.082993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-37260736-cccc-4d1a-a236-38a1f58831b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:31.093410 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 814/1624] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 17 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:31.094268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37260736-cccc-4d1a-a236-38a1f58831b1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:31.105491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37260736-cccc-4d1a-a236-38a1f58831b1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:31.111353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765808ac-95d2-480d-8c36-22f5921fba15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:31.111974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765808ac-95d2-480d-8c36-22f5921fba15 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.112250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765808ac-95d2-480d-8c36-22f5921fba15 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.117038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765808ac-95d2-480d-8c36-22f5921fba15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.117215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 811/1625] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:30 2022] POST /identity/v3/projects => generated 365 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:31.117215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c76a9-b448-4a30-b189-37c1fef791b6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:31.183139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765808ac-95d2-480d-8c36-22f5921fba15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:31.185163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765808ac-95d2-480d-8c36-22f5921fba15 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:31.188257 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c76a9-b448-4a30-b189-37c1fef791b6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:31.193117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c622ef8-635b-4285-b7a7-8b9c18413748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:31.195545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c622ef8-635b-4285-b7a7-8b9c18413748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.195545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c622ef8-635b-4285-b7a7-8b9c18413748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.195545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c622ef8-635b-4285-b7a7-8b9c18413748 admin admin] PATH_INFO: `/v3/projects/935b40f1587342a29ef02ee06443fea3/users/00d3345dab98484cb19ec2353c1a6166/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.196259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 815/1626] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:31.196389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c622ef8-635b-4285-b7a7-8b9c18413748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935b40f1587342a29ef02ee06443fea3, user_id=00d3345dab98484cb19ec2353c1a6166, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:31.199861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c622ef8-635b-4285-b7a7-8b9c18413748 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:31.207312 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765808ac-95d2-480d-8c36-22f5921fba15 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:31.220831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765808ac-95d2-480d-8c36-22f5921fba15 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:31.221007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 812/1627] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:31 2022] PUT /identity/v3/projects/935b40f1587342a29ef02ee06443fea3/users/00d3345dab98484cb19ec2353c1a6166/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:31.221974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c622ef8-635b-4285-b7a7-8b9c18413748 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:31.309157 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c622ef8-635b-4285-b7a7-8b9c18413748 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:31.314583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090140c-1a1d-4673-b410-bbcf091d207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:31.315346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090140c-1a1d-4673-b410-bbcf091d207e admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.316919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090140c-1a1d-4673-b410-bbcf091d207e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.317285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090140c-1a1d-4673-b410-bbcf091d207e admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.318696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090140c-1a1d-4673-b410-bbcf091d207e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:31.321056 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090140c-1a1d-4673-b410-bbcf091d207e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:31.346626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed9feb-7a93-4b5c-bc6a-805e0a869aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:31.347478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed9feb-7a93-4b5c-bc6a-805e0a869aa4 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.347612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed9feb-7a93-4b5c-bc6a-805e0a869aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.347782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed9feb-7a93-4b5c-bc6a-805e0a869aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.443661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 813/1628] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:31 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:31.443661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9d1d0-58e7-4dcb-8cdb-91cd37bd696a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.443661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9d1d0-58e7-4dcb-8cdb-91cd37bd696a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.443661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9d1d0-58e7-4dcb-8cdb-91cd37bd696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.463275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed9feb-7a93-4b5c-bc6a-805e0a869aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:31.467290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed9feb-7a93-4b5c-bc6a-805e0a869aa4 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:31.482684 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-aaa9d1d0-58e7-4dcb-8cdb-91cd37bd696a None None] MFA Rules not processed for user `00d3345dab98484cb19ec2353c1a6166`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:31.484302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-aaa9d1d0-58e7-4dcb-8cdb-91cd37bd696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:31.490118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 816/1629] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:31.491019 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed9feb-7a93-4b5c-bc6a-805e0a869aa4 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:31.502859 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed9feb-7a93-4b5c-bc6a-805e0a869aa4 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:31.507865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0ae19-01a6-433f-beb6-c9c3fe48cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:31.508480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0ae19-01a6-433f-beb6-c9c3fe48cfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.508754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0ae19-01a6-433f-beb6-c9c3fe48cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.509023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0ae19-01a6-433f-beb6-c9c3fe48cfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.510619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0ae19-01a6-433f-beb6-c9c3fe48cfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:31.513713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0ae19-01a6-433f-beb6-c9c3fe48cfd2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:31.530474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 817/1630] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:31.531716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0ae19-01a6-433f-beb6-c9c3fe48cfd2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:31.542469 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0ae19-01a6-433f-beb6-c9c3fe48cfd2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:31.548012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b10fa3-acbb-4658-97b4-c1f7ec695b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:31.548888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10fa3-acbb-4658-97b4-c1f7ec695b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.550539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10fa3-acbb-4658-97b4-c1f7ec695b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.550539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10fa3-acbb-4658-97b4-c1f7ec695b35 admin admin] PATH_INFO: `/v3/projects/cb05495df16149be9eff4195dddbae5e/users/420aca5bb8ec43f8859ea8982178c2b0/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.581617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b10fa3-acbb-4658-97b4-c1f7ec695b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb05495df16149be9eff4195dddbae5e, user_id=420aca5bb8ec43f8859ea8982178c2b0, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:31.587507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b10fa3-acbb-4658-97b4-c1f7ec695b35 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:31.647509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 814/1631] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:31.653114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9d1d0-58e7-4dcb-8cdb-91cd37bd696a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:31.733192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9d1d0-58e7-4dcb-8cdb-91cd37bd696a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:31.736561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 818/1632] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:31 2022] PUT /identity/v3/projects/cb05495df16149be9eff4195dddbae5e/users/420aca5bb8ec43f8859ea8982178c2b0/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:31.738189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df31144-d970-4756-b91f-99b2e05da764 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.738631 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df31144-d970-4756-b91f-99b2e05da764 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.739081 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df31144-d970-4756-b91f-99b2e05da764 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.741561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 819/1633] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 17 16:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:23:31.742359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df31144-d970-4756-b91f-99b2e05da764 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:31.890331 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1805f-04c0-450c-a43f-c98c6298c044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:31.891152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1805f-04c0-450c-a43f-c98c6298c044 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.891740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1805f-04c0-450c-a43f-c98c6298c044 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.892025 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1805f-04c0-450c-a43f-c98c6298c044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.911064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df31144-d970-4756-b91f-99b2e05da764 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:31.917423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b634c-a59c-46bf-829c-f1b3fe24ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:31.918191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b634c-a59c-46bf-829c-f1b3fe24ce3e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.918570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b634c-a59c-46bf-829c-f1b3fe24ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.918958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b634c-a59c-46bf-829c-f1b3fe24ce3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.920610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b634c-a59c-46bf-829c-f1b3fe24ce3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:31.922792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b634c-a59c-46bf-829c-f1b3fe24ce3e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:31.938830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 820/1634] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:31.940999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa669e4-3173-4069-8b16-c796433acd9e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:31.940999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa669e4-3173-4069-8b16-c796433acd9e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:31.941472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa669e4-3173-4069-8b16-c796433acd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:31.977500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1fa669e4-3173-4069-8b16-c796433acd9e None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:31.978910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1fa669e4-3173-4069-8b16-c796433acd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:31.981782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1805f-04c0-450c-a43f-c98c6298c044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:31.983736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1805f-04c0-450c-a43f-c98c6298c044 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:31.999166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 815/1635] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:23:32.000323 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec571-99d6-444c-ac10-1c523f060bdc None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:32.000622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec571-99d6-444c-ac10-1c523f060bdc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:32.000883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcec571-99d6-444c-ac10-1c523f060bdc None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:32.002798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 816/1636] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 17 16:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:23:32.003489 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcec571-99d6-444c-ac10-1c523f060bdc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:32.021743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcec571-99d6-444c-ac10-1c523f060bdc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:32.028723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ff2fa-5685-4ddf-9e95-e9efed7447db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:32.033479 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ff2fa-5685-4ddf-9e95-e9efed7447db admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:32.034891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ff2fa-5685-4ddf-9e95-e9efed7447db admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:32.035839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ff2fa-5685-4ddf-9e95-e9efed7447db admin admin] PATH_INFO: `/v3/projects/cb05495df16149be9eff4195dddbae5e/users/420aca5bb8ec43f8859ea8982178c2b0/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:32.039951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ff2fa-5685-4ddf-9e95-e9efed7447db admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb05495df16149be9eff4195dddbae5e, user_id=420aca5bb8ec43f8859ea8982178c2b0, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:32.045660 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ff2fa-5685-4ddf-9e95-e9efed7447db admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:32.061873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:32.065638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 817/1637] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:32 2022] PUT /identity/v3/projects/cb05495df16149be9eff4195dddbae5e/users/420aca5bb8ec43f8859ea8982178c2b0/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:32.067613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d990-b59d-41cf-89e8-eb6c4b115d7c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:32.068163 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d990-b59d-41cf-89e8-eb6c4b115d7c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:32.068369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d990-b59d-41cf-89e8-eb6c4b115d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:32.078871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 821/1638] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:32.080497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d838f-14b0-4e54-a6a3-46039e6db52e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:32.080872 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d838f-14b0-4e54-a6a3-46039e6db52e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:32.081239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d838f-14b0-4e54-a6a3-46039e6db52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:32.112970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8ca1d990-b59d-41cf-89e8-eb6c4b115d7c None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:32.122956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8ca1d990-b59d-41cf-89e8-eb6c4b115d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:32.128282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fb3d838f-14b0-4e54-a6a3-46039e6db52e None None] MFA Rules not processed for user `420aca5bb8ec43f8859ea8982178c2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:32.130505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fb3d838f-14b0-4e54-a6a3-46039e6db52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:32.181504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:32.245155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 818/1639] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:23:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:32.246021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1d990-b59d-41cf-89e8-eb6c4b115d7c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:32.251952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 822/1640] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:32.323396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d838f-14b0-4e54-a6a3-46039e6db52e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:32.345204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1d990-b59d-41cf-89e8-eb6c4b115d7c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:32.365228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320bfb-4e94-40ec-b60a-36c7709a0bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:32.365900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320bfb-4e94-40ec-b60a-36c7709a0bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:32.366179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320bfb-4e94-40ec-b60a-36c7709a0bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:32.366452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320bfb-4e94-40ec-b60a-36c7709a0bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:32.391391 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11320bfb-4e94-40ec-b60a-36c7709a0bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:32.393233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11320bfb-4e94-40ec-b60a-36c7709a0bd7 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:32.407946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d838f-14b0-4e54-a6a3-46039e6db52e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:32.417436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 819/1641] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:32.420271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86adb53-fa95-44df-924d-f833adde6561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:32.421473 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86adb53-fa95-44df-924d-f833adde6561 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:32.421785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86adb53-fa95-44df-924d-f833adde6561 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:32.422032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86adb53-fa95-44df-924d-f833adde6561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:32.436006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86adb53-fa95-44df-924d-f833adde6561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:32.436981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86adb53-fa95-44df-924d-f833adde6561 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:32.450633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 823/1642] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:32.488027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:32.623119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320bfb-4e94-40ec-b60a-36c7709a0bd7 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:32.633931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320bfb-4e94-40ec-b60a-36c7709a0bd7 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:32.642360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deadd03-a63b-4a09-b762-cf82d94a1d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:32.643634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deadd03-a63b-4a09-b762-cf82d94a1d7c service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:32.644074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deadd03-a63b-4a09-b762-cf82d94a1d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:32.644425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deadd03-a63b-4a09-b762-cf82d94a1d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:32.660492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deadd03-a63b-4a09-b762-cf82d94a1d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:32.662155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deadd03-a63b-4a09-b762-cf82d94a1d7c service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:32.681829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 820/1643] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:23:33.288811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:33.508436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86adb53-fa95-44df-924d-f833adde6561 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:33.517889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86adb53-fa95-44df-924d-f833adde6561 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:33.523047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fbabb-5444-4b14-bdfb-1f4822cc36f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:33.523796 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fbabb-5444-4b14-bdfb-1f4822cc36f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:33.524248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fbabb-5444-4b14-bdfb-1f4822cc36f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:33.524567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fbabb-5444-4b14-bdfb-1f4822cc36f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:33.601478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fbabb-5444-4b14-bdfb-1f4822cc36f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:33.603212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fbabb-5444-4b14-bdfb-1f4822cc36f0 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:33.617891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 824/1644] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:35.135492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deadd03-a63b-4a09-b762-cf82d94a1d7c service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:35.249465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deadd03-a63b-4a09-b762-cf82d94a1d7c service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:35.256099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:35.256951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:35.261596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:35.261596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] PATH_INFO: `/v3/users/cf3ff8a4269a4dd0a53387f60d60a613` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:35.277141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3ff8a4269a4dd0a53387f60d60a613)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:35.286385 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:35.612296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3ff8a4269a4dd0a53387f60d60a613'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:35.613207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3ff8a4269a4dd0a53387f60d60a613'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:35.628771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:35.632197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3ff8a4269a4dd0a53387f60d60a613'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:35.663522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3ff8a4269a4dd0a53387f60d60a613'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:35.785946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3ff8a4269a4dd0a53387f60d60a613'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:35.840425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 821/1645] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:35 2022] DELETE /identity/v3/users/cf3ff8a4269a4dd0a53387f60d60a613 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:35.844723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd4f5-9699-4672-b4d5-795277eb7c2d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:35.845252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd4f5-9699-4672-b4d5-795277eb7c2d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:35.845252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd4f5-9699-4672-b4d5-795277eb7c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:35.953181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dafdd4f5-9699-4672-b4d5-795277eb7c2d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:35.958154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dafdd4f5-9699-4672-b4d5-795277eb7c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:36.016596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:36.084837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 825/1646] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:36.106799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:36.108963 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:36.280883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477fd27-e4c3-4954-a305-977932e07db4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:36.286207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14984ee1-5d8e-4322-871e-af1cfe72a4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:36.288457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14984ee1-5d8e-4322-871e-af1cfe72a4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:36.288890 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14984ee1-5d8e-4322-871e-af1cfe72a4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:36.289305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14984ee1-5d8e-4322-871e-af1cfe72a4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:36.326493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14984ee1-5d8e-4322-871e-af1cfe72a4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:36.328819 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14984ee1-5d8e-4322-871e-af1cfe72a4e5 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:36.341509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 822/1647] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:36.642734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd4f5-9699-4672-b4d5-795277eb7c2d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:36.648835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dafdd4f5-9699-4672-b4d5-795277eb7c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:36.679553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd4f5-9699-4672-b4d5-795277eb7c2d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:36.688080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:36.689039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:36.689520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:36.690869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] PATH_INFO: `/v3/users/7c0102d91c2a4366ab207651cee40321` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:36.693413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0102d91c2a4366ab207651cee40321)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:36.695047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:23:36.695047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: warnings.warn(msg) Aug 17 16:23:36.695047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: Aug 17 16:23:36.698374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:37.089882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14984ee1-5d8e-4322-871e-af1cfe72a4e5 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:37.091778 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-14984ee1-5d8e-4322-871e-af1cfe72a4e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:37.110136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0102d91c2a4366ab207651cee40321'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:37.111395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0102d91c2a4366ab207651cee40321'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:37.131500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14984ee1-5d8e-4322-871e-af1cfe72a4e5 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:37.149896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:37.151027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:37.151453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:37.152160 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] PATH_INFO: `/v3/projects/0642f4a1afc44559829ea45dd48f0d09` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:37.156379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0642f4a1afc44559829ea45dd48f0d09)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:37.162240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:23:37.162240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: warnings.warn(msg) Aug 17 16:23:37.162240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: Aug 17 16:23:37.175902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:37.204522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0102d91c2a4366ab207651cee40321'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:37.241837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0102d91c2a4366ab207651cee40321'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:37.244015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-38f8c34a-2074-49bb-9c70-7fe5d3230efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0102d91c2a4366ab207651cee40321'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:37.361430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 826/1648] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:36 2022] DELETE /identity/v3/users/7c0102d91c2a4366ab207651cee40321 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:37.364610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e95a5-e14f-4c2d-afac-efa49d3c49a2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:37.364904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e95a5-e14f-4c2d-afac-efa49d3c49a2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:37.365184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e95a5-e14f-4c2d-afac-efa49d3c49a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:37.419312 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-df7e95a5-e14f-4c2d-afac-efa49d3c49a2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:37.420577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-df7e95a5-e14f-4c2d-afac-efa49d3c49a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:37.427016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0642f4a1afc44559829ea45dd48f0d09', 'request_id': 'req-e909b827-e025-4861-a972-795f19261b91'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:37.441974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0642f4a1afc44559829ea45dd48f0d09', 'request_id': 'req-e909b827-e025-4861-a972-795f19261b91'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:37.506253 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0642f4a1afc44559829ea45dd48f0d09', 'request_id': 'req-e909b827-e025-4861-a972-795f19261b91'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:37.535069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] The token cache is being invalidate because project 0642f4a1afc44559829ea45dd48f0d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:23:37.535365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:37.536605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:37.539188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 823/1649] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:23:37 2022] DELETE /identity/v3/projects/0642f4a1afc44559829ea45dd48f0d09 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:37.544645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:37.547001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:37.551130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 827/1650] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:37.562198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e95a5-e14f-4c2d-afac-efa49d3c49a2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:37.564170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-df7e95a5-e14f-4c2d-afac-efa49d3c49a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:37.675077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:37.680779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:37.688912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909b827-e025-4861-a972-795f19261b91 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:37.701454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e95a5-e14f-4c2d-afac-efa49d3c49a2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:37.703269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999399be-e266-4675-83cd-8b6c8892b368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:37.704054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999399be-e266-4675-83cd-8b6c8892b368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:37.704359 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999399be-e266-4675-83cd-8b6c8892b368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:37.704637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999399be-e266-4675-83cd-8b6c8892b368 admin admin] PATH_INFO: `/v3/users/420aca5bb8ec43f8859ea8982178c2b0` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:37.706164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999399be-e266-4675-83cd-8b6c8892b368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420aca5bb8ec43f8859ea8982178c2b0)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:37.707560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8bc17-b182-48d4-a1b1-6bac7e19c409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:37.708392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8bc17-b182-48d4-a1b1-6bac7e19c409 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:37.708831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8bc17-b182-48d4-a1b1-6bac7e19c409 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:37.709868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8bc17-b182-48d4-a1b1-6bac7e19c409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:37.711435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999399be-e266-4675-83cd-8b6c8892b368 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:37.712171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8ef8bc17-b182-48d4-a1b1-6bac7e19c409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:37.730786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8bc17-b182-48d4-a1b1-6bac7e19c409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:37.732789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8bc17-b182-48d4-a1b1-6bac7e19c409 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:37.759151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 828/1651] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:23:38.076427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-999399be-e266-4675-83cd-8b6c8892b368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420aca5bb8ec43f8859ea8982178c2b0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:38.085020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-999399be-e266-4675-83cd-8b6c8892b368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420aca5bb8ec43f8859ea8982178c2b0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:38.096922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-999399be-e266-4675-83cd-8b6c8892b368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420aca5bb8ec43f8859ea8982178c2b0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:38.117296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-999399be-e266-4675-83cd-8b6c8892b368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420aca5bb8ec43f8859ea8982178c2b0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:38.207480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-999399be-e266-4675-83cd-8b6c8892b368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420aca5bb8ec43f8859ea8982178c2b0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:38.223588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 824/1652] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:37 2022] DELETE /identity/v3/users/420aca5bb8ec43f8859ea8982178c2b0 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:23:38.403193 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8bc17-b182-48d4-a1b1-6bac7e19c409 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:38.414036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8ef8bc17-b182-48d4-a1b1-6bac7e19c409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:38.465069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8bc17-b182-48d4-a1b1-6bac7e19c409 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:38.647816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:38.648547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:38.648833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:38.649112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] PATH_INFO: `/v3/projects/fa099c8716e242069bb76ded83795b54` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:38.650605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa099c8716e242069bb76ded83795b54)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:38.653063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:38.841072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa099c8716e242069bb76ded83795b54', 'request_id': 'req-21499de6-ce94-4d79-9368-3fbef738a1b6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:38.857132 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa099c8716e242069bb76ded83795b54', 'request_id': 'req-21499de6-ce94-4d79-9368-3fbef738a1b6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:38.876404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa099c8716e242069bb76ded83795b54', 'request_id': 'req-21499de6-ce94-4d79-9368-3fbef738a1b6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:38.958313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] The token cache is being invalidate because project fa099c8716e242069bb76ded83795b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:23:38.958602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:38.967216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-21499de6-ce94-4d79-9368-3fbef738a1b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:38.967216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 829/1653] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:23:38 2022] DELETE /identity/v3/projects/fa099c8716e242069bb76ded83795b54 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:38.968800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143bf62-11b1-4747-8a56-33a4f46ab63d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:38.969592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143bf62-11b1-4747-8a56-33a4f46ab63d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:38.970015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143bf62-11b1-4747-8a56-33a4f46ab63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:39.007667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7143bf62-11b1-4747-8a56-33a4f46ab63d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:39.012194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7143bf62-11b1-4747-8a56-33a4f46ab63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:39.105251 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 825/1654] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:39.112822 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2baa8f-b73a-482f-a7df-0bf01dfbf451 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:39.113162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2baa8f-b73a-482f-a7df-0bf01dfbf451 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:39.113428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2baa8f-b73a-482f-a7df-0bf01dfbf451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:39.148479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fc2baa8f-b73a-482f-a7df-0bf01dfbf451 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:39.150005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fc2baa8f-b73a-482f-a7df-0bf01dfbf451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:39.168180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 830/1655] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:39.169908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143bf62-11b1-4747-8a56-33a4f46ab63d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:39.185896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143bf62-11b1-4747-8a56-33a4f46ab63d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:39.191152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17fcd4-3aae-453f-8403-62f24376bfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:39.192023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17fcd4-3aae-453f-8403-62f24376bfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:39.192503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17fcd4-3aae-453f-8403-62f24376bfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:39.193245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17fcd4-3aae-453f-8403-62f24376bfb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:39.194430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17fcd4-3aae-453f-8403-62f24376bfb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:39.194949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17fcd4-3aae-453f-8403-62f24376bfb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:39.197962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc17fcd4-3aae-453f-8403-62f24376bfb6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:39.211874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 826/1656] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:39.219164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2baa8f-b73a-482f-a7df-0bf01dfbf451 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:39.248070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2baa8f-b73a-482f-a7df-0bf01dfbf451 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:39.253095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834d0ff-ccc2-484b-8145-781679c589df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:39.254005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d0ff-ccc2-484b-8145-781679c589df admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:39.254289 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d0ff-ccc2-484b-8145-781679c589df admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:39.254560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d0ff-ccc2-484b-8145-781679c589df admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:39.255438 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834d0ff-ccc2-484b-8145-781679c589df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:39.258213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834d0ff-ccc2-484b-8145-781679c589df admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:39.410394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 831/1657] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:39 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:39.414540 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17fcd4-3aae-453f-8403-62f24376bfb6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:39.432020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17fcd4-3aae-453f-8403-62f24376bfb6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:39.577063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950113c6-53a9-45f8-886c-123e2a31c422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:39.578135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950113c6-53a9-45f8-886c-123e2a31c422 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:39.579972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950113c6-53a9-45f8-886c-123e2a31c422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:39.580268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950113c6-53a9-45f8-886c-123e2a31c422 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:39.580968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950113c6-53a9-45f8-886c-123e2a31c422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:39.586554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950113c6-53a9-45f8-886c-123e2a31c422 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:39.654960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:39.688606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 827/1658] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:39 2022] POST /identity/v3/users => generated 286 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:39.692678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834d0ff-ccc2-484b-8145-781679c589df admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:39.712288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834d0ff-ccc2-484b-8145-781679c589df admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:39.722570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5f69d-ca5d-418c-9e01-a4be1f7f4209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:39.723209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f69d-ca5d-418c-9e01-a4be1f7f4209 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:39.723482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f69d-ca5d-418c-9e01-a4be1f7f4209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:39.723757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f69d-ca5d-418c-9e01-a4be1f7f4209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:39.724471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5f69d-ca5d-418c-9e01-a4be1f7f4209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:39.726974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5f69d-ca5d-418c-9e01-a4be1f7f4209 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:39.754386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 832/1659] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:39.758755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950113c6-53a9-45f8-886c-123e2a31c422 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:39.773182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950113c6-53a9-45f8-886c-123e2a31c422 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:39.776806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5f69d-ca5d-418c-9e01-a4be1f7f4209 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:39.780797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1da5f69d-ca5d-418c-9e01-a4be1f7f4209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:39.801957 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ec48e-585c-4f3e-8be4-3a483dac7cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:39.802798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec48e-585c-4f3e-8be4-3a483dac7cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:39.803257 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec48e-585c-4f3e-8be4-3a483dac7cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:39.803701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec48e-585c-4f3e-8be4-3a483dac7cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:39.804553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ec48e-585c-4f3e-8be4-3a483dac7cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:39.808486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ec48e-585c-4f3e-8be4-3a483dac7cc8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:39.815049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5f69d-ca5d-418c-9e01-a4be1f7f4209 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:39.829905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 828/1660] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:23:39.833476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:39.834418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:39.835112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:39.835582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] PATH_INFO: `/v3/projects/cb05495df16149be9eff4195dddbae5e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:39.836937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ec48e-585c-4f3e-8be4-3a483dac7cc8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:39.838619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb05495df16149be9eff4195dddbae5e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:39.842557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:39.862435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ec48e-585c-4f3e-8be4-3a483dac7cc8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:39.874814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9e451-7b5b-43fe-8902-d2cf509668fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:39.875823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9e451-7b5b-43fe-8902-d2cf509668fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:39.876299 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9e451-7b5b-43fe-8902-d2cf509668fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:39.876734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9e451-7b5b-43fe-8902-d2cf509668fc admin admin] PATH_INFO: `/v3/projects/f9631fbd2d8849aeac168ac6e1040f9d/users/c1f79fc28dc1412381620c7eb4d81c64/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:39.913317 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9e451-7b5b-43fe-8902-d2cf509668fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9631fbd2d8849aeac168ac6e1040f9d, user_id=c1f79fc28dc1412381620c7eb4d81c64, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:39.917674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9e451-7b5b-43fe-8902-d2cf509668fc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:40.030967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 829/1661] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:39 2022] PUT /identity/v3/projects/f9631fbd2d8849aeac168ac6e1040f9d/users/c1f79fc28dc1412381620c7eb4d81c64/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:40.041427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:40.043358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fcf69-0093-4ceb-b134-9aae4b675e8b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:40.043358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fcf69-0093-4ceb-b134-9aae4b675e8b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:40.043358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fcf69-0093-4ceb-b134-9aae4b675e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:40.073217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb05495df16149be9eff4195dddbae5e', 'request_id': 'req-edbae9e9-ee98-44e8-819f-8c37ab77df25'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:40.085493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb05495df16149be9eff4195dddbae5e', 'request_id': 'req-edbae9e9-ee98-44e8-819f-8c37ab77df25'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:40.100725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb05495df16149be9eff4195dddbae5e', 'request_id': 'req-edbae9e9-ee98-44e8-819f-8c37ab77df25'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:40.115488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-cc8fcf69-0093-4ceb-b134-9aae4b675e8b None None] MFA Rules not processed for user `c1f79fc28dc1412381620c7eb4d81c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:40.115488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cc8fcf69-0093-4ceb-b134-9aae4b675e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:40.189620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] The token cache is being invalidate because project cb05495df16149be9eff4195dddbae5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:23:40.189910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:40.190783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-edbae9e9-ee98-44e8-819f-8c37ab77df25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:40.193435 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 833/1662] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:23:39 2022] DELETE /identity/v3/projects/cb05495df16149be9eff4195dddbae5e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:40.199300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a450b-5f11-4af0-b3fc-988ff0c3d38a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:40.199785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a450b-5f11-4af0-b3fc-988ff0c3d38a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:40.200203 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a450b-5f11-4af0-b3fc-988ff0c3d38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:40.213553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 830/1663] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:40.217067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fcf69-0093-4ceb-b134-9aae4b675e8b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:40.240971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-820a450b-5f11-4af0-b3fc-988ff0c3d38a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:40.243296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-820a450b-5f11-4af0-b3fc-988ff0c3d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:40.376104 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 834/1664] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:40.389378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fcf69-0093-4ceb-b134-9aae4b675e8b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:40.396412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd523b0-a31c-4f86-a330-8d7f3c63224b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:40.397493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd523b0-a31c-4f86-a330-8d7f3c63224b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:40.397944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd523b0-a31c-4f86-a330-8d7f3c63224b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:40.406812 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e3390-6184-4a48-8c0c-00f16d320498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:40.407597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e3390-6184-4a48-8c0c-00f16d320498 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:40.408120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e3390-6184-4a48-8c0c-00f16d320498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:40.408588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e3390-6184-4a48-8c0c-00f16d320498 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:40.409513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e3390-6184-4a48-8c0c-00f16d320498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:40.415321 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e3390-6184-4a48-8c0c-00f16d320498 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:40.461093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8cd523b0-a31c-4f86-a330-8d7f3c63224b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:40.465143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8cd523b0-a31c-4f86-a330-8d7f3c63224b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:40.490428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 835/1665] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:40.499817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd523b0-a31c-4f86-a330-8d7f3c63224b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:40.535297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 831/1666] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:40 2022] POST /identity/v3/projects => generated 371 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:40.537297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd523b0-a31c-4f86-a330-8d7f3c63224b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:40.550687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e3390-6184-4a48-8c0c-00f16d320498 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:40.557888 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-895e3390-6184-4a48-8c0c-00f16d320498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:40.720547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f21447-9f88-4a82-8ecf-cd9ec8cd2788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:40.721637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f21447-9f88-4a82-8ecf-cd9ec8cd2788 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:40.724533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f21447-9f88-4a82-8ecf-cd9ec8cd2788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:40.725693 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f21447-9f88-4a82-8ecf-cd9ec8cd2788 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:40.727731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f21447-9f88-4a82-8ecf-cd9ec8cd2788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:40.733916 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e3390-6184-4a48-8c0c-00f16d320498 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:40.735262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f21447-9f88-4a82-8ecf-cd9ec8cd2788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:40.737229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f21447-9f88-4a82-8ecf-cd9ec8cd2788 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:40.746384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cd50a-a878-4686-81d4-13b959b5780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:40.747301 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cd50a-a878-4686-81d4-13b959b5780b admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:40.747720 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cd50a-a878-4686-81d4-13b959b5780b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:40.748120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cd50a-a878-4686-81d4-13b959b5780b admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:40.750164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cd50a-a878-4686-81d4-13b959b5780b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:40.756308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cd50a-a878-4686-81d4-13b959b5780b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:40.787988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 836/1667] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:40.788967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f21447-9f88-4a82-8ecf-cd9ec8cd2788 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:40.811972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f21447-9f88-4a82-8ecf-cd9ec8cd2788 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:40.854382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 832/1668] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:40 2022] POST /identity/v3/users => generated 292 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:40.854639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c63af-5c6b-4469-9da3-ad1247201418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:40.858265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cd50a-a878-4686-81d4-13b959b5780b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:40.858979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c63af-5c6b-4469-9da3-ad1247201418 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:40.859431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c63af-5c6b-4469-9da3-ad1247201418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:40.859836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c63af-5c6b-4469-9da3-ad1247201418 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:40.860608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c63af-5c6b-4469-9da3-ad1247201418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:40.862856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c63af-5c6b-4469-9da3-ad1247201418 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:40.895297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cd50a-a878-4686-81d4-13b959b5780b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:40.912584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff3e46-d133-422e-8e5b-513b86f0661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:40.913627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff3e46-d133-422e-8e5b-513b86f0661b admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:40.913898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff3e46-d133-422e-8e5b-513b86f0661b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:40.914217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff3e46-d133-422e-8e5b-513b86f0661b admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:40.914865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff3e46-d133-422e-8e5b-513b86f0661b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:40.929030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff3e46-d133-422e-8e5b-513b86f0661b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:40.976970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 833/1669] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:40.977946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff3e46-d133-422e-8e5b-513b86f0661b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:41.011131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff3e46-d133-422e-8e5b-513b86f0661b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:41.030135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648899bd-767d-4308-8d92-395824836c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:41.031123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648899bd-767d-4308-8d92-395824836c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:41.032887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648899bd-767d-4308-8d92-395824836c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:41.034244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648899bd-767d-4308-8d92-395824836c2d admin admin] PATH_INFO: `/v3/projects/f8d43be5ee2b477a9d41c3f2e08b3500/users/8f3c6d6e5d7c4dd2b084d583172e6ad4/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:41.039292 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 837/1670] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:40 2022] POST /identity/v3/projects => generated 367 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:41.047073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c63af-5c6b-4469-9da3-ad1247201418 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:41.091034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648899bd-767d-4308-8d92-395824836c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d43be5ee2b477a9d41c3f2e08b3500, user_id=8f3c6d6e5d7c4dd2b084d583172e6ad4, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:41.098110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648899bd-767d-4308-8d92-395824836c2d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:41.182776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 834/1671] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:40 2022] PUT /identity/v3/projects/f8d43be5ee2b477a9d41c3f2e08b3500/users/8f3c6d6e5d7c4dd2b084d583172e6ad4/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:41.183748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648899bd-767d-4308-8d92-395824836c2d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:41.188480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-648899bd-767d-4308-8d92-395824836c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:41.200292 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c63af-5c6b-4469-9da3-ad1247201418 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:41.349121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6f249-0dcd-4b51-b7fd-d86b0bf5bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:41.352098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648899bd-767d-4308-8d92-395824836c2d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:41.355451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f249-0dcd-4b51-b7fd-d86b0bf5bda1 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:41.355817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f249-0dcd-4b51-b7fd-d86b0bf5bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:41.356095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f249-0dcd-4b51-b7fd-d86b0bf5bda1 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:41.356770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6f249-0dcd-4b51-b7fd-d86b0bf5bda1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:41.361628 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6f249-0dcd-4b51-b7fd-d86b0bf5bda1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:41.370087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:41.370746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:41.373578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:41.373578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] PATH_INFO: `/v3/users/bae20451f7774444a39c838589c82810` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:41.374613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bae20451f7774444a39c838589c82810)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:41.379948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:41.533399 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 838/1672] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:41 2022] POST /identity/v3/users => generated 284 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:41.534891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6f249-0dcd-4b51-b7fd-d86b0bf5bda1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:41.565998 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6f249-0dcd-4b51-b7fd-d86b0bf5bda1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:41.567030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:41.588981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2968ff-d60f-40aa-ab83-4c1adee777c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:41.589867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2968ff-d60f-40aa-ab83-4c1adee777c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:41.590225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2968ff-d60f-40aa-ab83-4c1adee777c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:41.590574 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2968ff-d60f-40aa-ab83-4c1adee777c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:41.591314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2968ff-d60f-40aa-ab83-4c1adee777c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:41.594806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2968ff-d60f-40aa-ab83-4c1adee777c5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:41.614791 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 839/1673] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:41.626442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2968ff-d60f-40aa-ab83-4c1adee777c5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:41.646177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bae20451f7774444a39c838589c82810'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:41.647406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bae20451f7774444a39c838589c82810'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:41.655135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2968ff-d60f-40aa-ab83-4c1adee777c5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:41.669951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bae20451f7774444a39c838589c82810'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:41.670704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd13af4-4047-45e7-ac6e-1098c01a060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:41.671572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd13af4-4047-45e7-ac6e-1098c01a060d admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:41.672019 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd13af4-4047-45e7-ac6e-1098c01a060d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:41.672503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd13af4-4047-45e7-ac6e-1098c01a060d admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:41.683514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd13af4-4047-45e7-ac6e-1098c01a060d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:41.687753 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd13af4-4047-45e7-ac6e-1098c01a060d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:41.699933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bae20451f7774444a39c838589c82810'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:41.710048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:41.723161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 840/1674] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:41.723161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd13af4-4047-45e7-ac6e-1098c01a060d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:41.748553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd13af4-4047-45e7-ac6e-1098c01a060d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:41.764912 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6047b-11c1-48dd-b65c-40ab25d3b73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:41.777042 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6047b-11c1-48dd-b65c-40ab25d3b73b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:41.777787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6047b-11c1-48dd-b65c-40ab25d3b73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:41.778281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6047b-11c1-48dd-b65c-40ab25d3b73b admin admin] PATH_INFO: `/v3/projects/f8d43be5ee2b477a9d41c3f2e08b3500/users/8f3c6d6e5d7c4dd2b084d583172e6ad4/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:41.782249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6047b-11c1-48dd-b65c-40ab25d3b73b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d43be5ee2b477a9d41c3f2e08b3500, user_id=8f3c6d6e5d7c4dd2b084d583172e6ad4, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:41.786629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6047b-11c1-48dd-b65c-40ab25d3b73b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:41.797643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bae20451f7774444a39c838589c82810'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:41.804873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 835/1675] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:41 2022] DELETE /identity/v3/users/bae20451f7774444a39c838589c82810 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:41.805916 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:41.806227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 841/1676] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:41 2022] PUT /identity/v3/projects/f8d43be5ee2b477a9d41c3f2e08b3500/users/8f3c6d6e5d7c4dd2b084d583172e6ad4/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:41.811233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:41.816563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d86fd-e20a-4746-9cd9-f51122f3d92e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:41.817693 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d86fd-e20a-4746-9cd9-f51122f3d92e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:41.818772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d86fd-e20a-4746-9cd9-f51122f3d92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:41.852621 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ce4d86fd-e20a-4746-9cd9-f51122f3d92e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:41.855448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ce4d86fd-e20a-4746-9cd9-f51122f3d92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:41.958096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 842/1677] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:41.960023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e0c4-4762-4443-8380-33a0cf2bb5dd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:41.960449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e0c4-4762-4443-8380-33a0cf2bb5dd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:41.960715 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e0c4-4762-4443-8380-33a0cf2bb5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:42.008876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6217e-70d6-48cc-9109-5e4038f655c8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:42.026546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e80b-2ef3-4fa7-84ea-6a15377a0959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:42.027384 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e80b-2ef3-4fa7-84ea-6a15377a0959 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:42.027662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e80b-2ef3-4fa7-84ea-6a15377a0959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:42.027927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e80b-2ef3-4fa7-84ea-6a15377a0959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:42.028686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8e80b-2ef3-4fa7-84ea-6a15377a0959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:42.029198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0875e0c4-4762-4443-8380-33a0cf2bb5dd None None] MFA Rules not processed for user `8f3c6d6e5d7c4dd2b084d583172e6ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:42.030468 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8e80b-2ef3-4fa7-84ea-6a15377a0959 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:42.030573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0875e0c4-4762-4443-8380-33a0cf2bb5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:42.066505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 836/1678] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:42.068048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e80b-2ef3-4fa7-84ea-6a15377a0959 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:42.078972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e1d8e80b-2ef3-4fa7-84ea-6a15377a0959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:42.167261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 843/1679] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:42.168036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875e0c4-4762-4443-8380-33a0cf2bb5dd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:42.195366 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875e0c4-4762-4443-8380-33a0cf2bb5dd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:42.209251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d821c0e-ac67-4c06-92b5-e7f1b5b38891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:42.209966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821c0e-ac67-4c06-92b5-e7f1b5b38891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:42.210243 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821c0e-ac67-4c06-92b5-e7f1b5b38891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:42.216668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821c0e-ac67-4c06-92b5-e7f1b5b38891 admin admin] PATH_INFO: `/v3/projects/4dccf9be359341e0a60f47ab13ad4146/users/faba40961d68471ebf78c012dcdf520c/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:42.236850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e80b-2ef3-4fa7-84ea-6a15377a0959 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:42.238296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d821c0e-ac67-4c06-92b5-e7f1b5b38891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dccf9be359341e0a60f47ab13ad4146, user_id=faba40961d68471ebf78c012dcdf520c, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:42.241017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d821c0e-ac67-4c06-92b5-e7f1b5b38891 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:42.252591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179557f8-18b6-4e1d-abc3-3c6b32a2917c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:42.253131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179557f8-18b6-4e1d-abc3-3c6b32a2917c service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:42.253463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179557f8-18b6-4e1d-abc3-3c6b32a2917c service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:42.253712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179557f8-18b6-4e1d-abc3-3c6b32a2917c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:42.272239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179557f8-18b6-4e1d-abc3-3c6b32a2917c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:42.273732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179557f8-18b6-4e1d-abc3-3c6b32a2917c service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:42.292843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 837/1680] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:42.294030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179557f8-18b6-4e1d-abc3-3c6b32a2917c service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:42.295589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-179557f8-18b6-4e1d-abc3-3c6b32a2917c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:42.339759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 844/1681] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:42 2022] PUT /identity/v3/projects/4dccf9be359341e0a60f47ab13ad4146/users/faba40961d68471ebf78c012dcdf520c/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:42.350282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb627-d59b-46c7-8372-e8fe7ff6d306 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:42.350920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb627-d59b-46c7-8372-e8fe7ff6d306 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:42.351417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb627-d59b-46c7-8372-e8fe7ff6d306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:42.418215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-75ecb627-d59b-46c7-8372-e8fe7ff6d306 None None] MFA Rules not processed for user `faba40961d68471ebf78c012dcdf520c`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:42.420895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-75ecb627-d59b-46c7-8372-e8fe7ff6d306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:42.430746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179557f8-18b6-4e1d-abc3-3c6b32a2917c service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:42.538170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f651-ac8e-40a2-a975-459122a115ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:42.540396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f651-ac8e-40a2-a975-459122a115ae service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:42.540984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f651-ac8e-40a2-a975-459122a115ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:42.546175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f651-ac8e-40a2-a975-459122a115ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:42.569714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 845/1682] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:23:42.575441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecb627-d59b-46c7-8372-e8fe7ff6d306 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:42.607157 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:42.686325 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecb627-d59b-46c7-8372-e8fe7ff6d306 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:42.688541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10f651-ac8e-40a2-a975-459122a115ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:42.690263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10f651-ac8e-40a2-a975-459122a115ae service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:42.697935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d914069-0151-416d-9a6b-eb00186bf33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:42.697935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d914069-0151-416d-9a6b-eb00186bf33e admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:42.697935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d914069-0151-416d-9a6b-eb00186bf33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:42.697935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d914069-0151-416d-9a6b-eb00186bf33e admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:42.698280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d914069-0151-416d-9a6b-eb00186bf33e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:42.699930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d914069-0151-416d-9a6b-eb00186bf33e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:42.731704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 838/1683] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:42.808664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 846/1684] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:42 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:42.811261 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f651-ac8e-40a2-a975-459122a115ae service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:42.841448 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f651-ac8e-40a2-a975-459122a115ae service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:43.010505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5341c0d-36ed-4db1-adf8-3f3efc37c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:43.011138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5341c0d-36ed-4db1-adf8-3f3efc37c265 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:43.011413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5341c0d-36ed-4db1-adf8-3f3efc37c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:43.011682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5341c0d-36ed-4db1-adf8-3f3efc37c265 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:43.012315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5341c0d-36ed-4db1-adf8-3f3efc37c265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:43.014301 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5341c0d-36ed-4db1-adf8-3f3efc37c265 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:43.129165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 839/1685] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:42 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:43.133207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d914069-0151-416d-9a6b-eb00186bf33e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:43.155751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d914069-0151-416d-9a6b-eb00186bf33e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:43.169609 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada82e4a-42ec-4da0-a742-d6887d7c1cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:43.170250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82e4a-42ec-4da0-a742-d6887d7c1cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:43.170533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82e4a-42ec-4da0-a742-d6887d7c1cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:43.189523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82e4a-42ec-4da0-a742-d6887d7c1cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:43.190326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada82e4a-42ec-4da0-a742-d6887d7c1cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:43.203050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada82e4a-42ec-4da0-a742-d6887d7c1cc6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:43.247085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 847/1686] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:43.251053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5341c0d-36ed-4db1-adf8-3f3efc37c265 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:43.267079 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5341c0d-36ed-4db1-adf8-3f3efc37c265 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:43.278041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25a7cd-5253-48db-8068-79a5c3da8497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:43.285624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25a7cd-5253-48db-8068-79a5c3da8497 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:43.285980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25a7cd-5253-48db-8068-79a5c3da8497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:43.286315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25a7cd-5253-48db-8068-79a5c3da8497 admin admin] PATH_INFO: `/v3/projects/8f8aebd029f74537984a9abb20fa3f94/users/f047918422af4cbe8713ce72c5bf6b91/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:43.344045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25a7cd-5253-48db-8068-79a5c3da8497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8aebd029f74537984a9abb20fa3f94, user_id=f047918422af4cbe8713ce72c5bf6b91, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:43.346792 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25a7cd-5253-48db-8068-79a5c3da8497 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:43.517897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 840/1687] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:43 2022] PUT /identity/v3/projects/8f8aebd029f74537984a9abb20fa3f94/users/f047918422af4cbe8713ce72c5bf6b91/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:43.521827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada82e4a-42ec-4da0-a742-d6887d7c1cc6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:43.539987 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada82e4a-42ec-4da0-a742-d6887d7c1cc6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:43.630267 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:43.749649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe623bf-d919-4aa4-854d-e44c34450408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:43.752308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe623bf-d919-4aa4-854d-e44c34450408 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:43.753037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe623bf-d919-4aa4-854d-e44c34450408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:43.754579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe623bf-d919-4aa4-854d-e44c34450408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:43.755274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe623bf-d919-4aa4-854d-e44c34450408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:43.760674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe623bf-d919-4aa4-854d-e44c34450408 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:43.782945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 848/1688] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:43.787092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25a7cd-5253-48db-8068-79a5c3da8497 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:43.809351 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25a7cd-5253-48db-8068-79a5c3da8497 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:43.815247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbac4d-06d0-47aa-ad50-b15717d0f2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:43.818586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbac4d-06d0-47aa-ad50-b15717d0f2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:43.819494 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbac4d-06d0-47aa-ad50-b15717d0f2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:43.824067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbac4d-06d0-47aa-ad50-b15717d0f2a4 admin admin] PATH_INFO: `/v3/projects/8f8aebd029f74537984a9abb20fa3f94/users/f047918422af4cbe8713ce72c5bf6b91/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:43.826299 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbac4d-06d0-47aa-ad50-b15717d0f2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8aebd029f74537984a9abb20fa3f94, user_id=f047918422af4cbe8713ce72c5bf6b91, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:43.864273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbac4d-06d0-47aa-ad50-b15717d0f2a4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:43.903119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 841/1689] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:43 2022] PUT /identity/v3/projects/8f8aebd029f74537984a9abb20fa3f94/users/f047918422af4cbe8713ce72c5bf6b91/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:43.905949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eff34-db45-4965-89a1-71758e50d44c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:43.905949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eff34-db45-4965-89a1-71758e50d44c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:43.905949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eff34-db45-4965-89a1-71758e50d44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:44.000503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-bd8eff34-db45-4965-89a1-71758e50d44c None None] MFA Rules not processed for user `f047918422af4cbe8713ce72c5bf6b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:44.001764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bd8eff34-db45-4965-89a1-71758e50d44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:44.241923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 849/1690] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:44.257766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbac4d-06d0-47aa-ad50-b15717d0f2a4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:44.315875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:44.391197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbac4d-06d0-47aa-ad50-b15717d0f2a4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:44.404360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ec05-1f43-4772-8215-68ddd73ffd96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:44.405669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ec05-1f43-4772-8215-68ddd73ffd96 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:44.406096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ec05-1f43-4772-8215-68ddd73ffd96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:44.406507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ec05-1f43-4772-8215-68ddd73ffd96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:44.428972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eff34-db45-4965-89a1-71758e50d44c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:44.436778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bd8eff34-db45-4965-89a1-71758e50d44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:44.437179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6ec05-1f43-4772-8215-68ddd73ffd96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:44.439431 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6ec05-1f43-4772-8215-68ddd73ffd96 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:44.454732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 842/1691] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:23:44.615468 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ec05-1f43-4772-8215-68ddd73ffd96 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:44.617713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0ad6ec05-1f43-4772-8215-68ddd73ffd96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:44.628161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eff34-db45-4965-89a1-71758e50d44c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:44.643634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ec05-1f43-4772-8215-68ddd73ffd96 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:44.649207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10544e3-7641-4034-8ae9-5fa3d41d1289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:44.649763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c0015-10f7-4375-9cf0-5c56b94277e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:44.650995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10544e3-7641-4034-8ae9-5fa3d41d1289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:44.651186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c0015-10f7-4375-9cf0-5c56b94277e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:44.651464 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c0015-10f7-4375-9cf0-5c56b94277e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:44.651732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c0015-10f7-4375-9cf0-5c56b94277e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:44.651982 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10544e3-7641-4034-8ae9-5fa3d41d1289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:44.652439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10544e3-7641-4034-8ae9-5fa3d41d1289 admin admin] PATH_INFO: `/v3/users/c1f79fc28dc1412381620c7eb4d81c64` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:44.656285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10544e3-7641-4034-8ae9-5fa3d41d1289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f79fc28dc1412381620c7eb4d81c64)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:44.658540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10544e3-7641-4034-8ae9-5fa3d41d1289 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:44.820059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:44.863487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c0015-10f7-4375-9cf0-5c56b94277e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:44.901006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c0015-10f7-4375-9cf0-5c56b94277e9 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:44.916193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 843/1692] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:44.917288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c0015-10f7-4375-9cf0-5c56b94277e9 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:44.918903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-915c0015-10f7-4375-9cf0-5c56b94277e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:44.988449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c0015-10f7-4375-9cf0-5c56b94277e9 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:45.000381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f10544e3-7641-4034-8ae9-5fa3d41d1289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f79fc28dc1412381620c7eb4d81c64'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:45.002313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f10544e3-7641-4034-8ae9-5fa3d41d1289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f79fc28dc1412381620c7eb4d81c64'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:45.002992 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:45.007683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:45.007972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:45.008253 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] PATH_INFO: `/v3/projects/3221414681654b5f99c26828d9ff57dc` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:45.011733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:45.013012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3221414681654b5f99c26828d9ff57dc)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:45.023089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:45.069452 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f10544e3-7641-4034-8ae9-5fa3d41d1289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f79fc28dc1412381620c7eb4d81c64'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:45.098724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f10544e3-7641-4034-8ae9-5fa3d41d1289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f79fc28dc1412381620c7eb4d81c64'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:45.101467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f10544e3-7641-4034-8ae9-5fa3d41d1289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f79fc28dc1412381620c7eb4d81c64'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:45.197668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 850/1693] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:44 2022] DELETE /identity/v3/users/c1f79fc28dc1412381620c7eb4d81c64 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:23:45.199381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba560ab-04bf-42ee-8ac9-b38851299a53 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:45.200001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba560ab-04bf-42ee-8ac9-b38851299a53 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:45.203134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba560ab-04bf-42ee-8ac9-b38851299a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:45.278153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3221414681654b5f99c26828d9ff57dc', 'request_id': 'req-6a792982-c118-4c8e-bbc1-8235f0032050'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:45.296210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3221414681654b5f99c26828d9ff57dc', 'request_id': 'req-6a792982-c118-4c8e-bbc1-8235f0032050'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:45.306552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-bba560ab-04bf-42ee-8ac9-b38851299a53 None None] MFA Rules not processed for user `b9d6d909e5e24923bbfc53fcf9975425`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:45.309990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bba560ab-04bf-42ee-8ac9-b38851299a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:45.429483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3221414681654b5f99c26828d9ff57dc', 'request_id': 'req-6a792982-c118-4c8e-bbc1-8235f0032050'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:45.446291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] The token cache is being invalidate because project 3221414681654b5f99c26828d9ff57dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:23:45.446625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:45.452723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6a792982-c118-4c8e-bbc1-8235f0032050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:45.457128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 844/1694] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:23:44 2022] DELETE /identity/v3/projects/3221414681654b5f99c26828d9ff57dc => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:45.466033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ddb8-7cd2-4fe6-b16b-a0ec3ab594d3 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:45.466033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ddb8-7cd2-4fe6-b16b-a0ec3ab594d3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:45.466213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ddb8-7cd2-4fe6-b16b-a0ec3ab594d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:45.485918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 851/1695] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:45.487448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0547633-5070-4460-8191-8dbc8b66f6eb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:45.487877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0547633-5070-4460-8191-8dbc8b66f6eb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:45.488337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0547633-5070-4460-8191-8dbc8b66f6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:45.531570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b0547633-5070-4460-8191-8dbc8b66f6eb None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:45.533162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b0547633-5070-4460-8191-8dbc8b66f6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:45.537324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2586ddb8-7cd2-4fe6-b16b-a0ec3ab594d3 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:45.539182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2586ddb8-7cd2-4fe6-b16b-a0ec3ab594d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:45.707079 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 852/1696] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:45.709217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0547633-5070-4460-8191-8dbc8b66f6eb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:45.713173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b0547633-5070-4460-8191-8dbc8b66f6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:45.797275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 845/1697] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:45.802992 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a4f81-e151-49c9-befe-82d26fcead84 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:45.803289 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a4f81-e151-49c9-befe-82d26fcead84 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:45.803570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a4f81-e151-49c9-befe-82d26fcead84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:45.870134 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e55a4f81-e151-49c9-befe-82d26fcead84 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:45.871389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e55a4f81-e151-49c9-befe-82d26fcead84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:45.878026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0547633-5070-4460-8191-8dbc8b66f6eb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:45.895285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75c401-a942-449d-ae80-4577c2b5369b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:45.895285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75c401-a942-449d-ae80-4577c2b5369b service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:45.895285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75c401-a942-449d-ae80-4577c2b5369b service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:45.895285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75c401-a942-449d-ae80-4577c2b5369b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:45.895661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 846/1698] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:45.896123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a4f81-e151-49c9-befe-82d26fcead84 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:45.898092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e55a4f81-e151-49c9-befe-82d26fcead84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:45.899091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5b75c401-a942-449d-ae80-4577c2b5369b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:45.906715 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:45.926911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75c401-a942-449d-ae80-4577c2b5369b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:45.928576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75c401-a942-449d-ae80-4577c2b5369b service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:45.940994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a4f81-e151-49c9-befe-82d26fcead84 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:45.973666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:45.974497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:45.976035 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:45.984290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] PATH_INFO: `/v3/users/5eccedcc85e34f88b2394d19d19538f4` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:45.984290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eccedcc85e34f88b2394d19d19538f4)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:45.989900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:45.997653 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 853/1699] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:45.998354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75c401-a942-449d-ae80-4577c2b5369b service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:46.011445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5b75c401-a942-449d-ae80-4577c2b5369b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:46.070360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:46.263766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75c401-a942-449d-ae80-4577c2b5369b service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:46.281540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301e9fb-6a76-4e88-8db4-82b08a4f746a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:46.282186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301e9fb-6a76-4e88-8db4-82b08a4f746a service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:46.282464 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301e9fb-6a76-4e88-8db4-82b08a4f746a service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:46.282738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301e9fb-6a76-4e88-8db4-82b08a4f746a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:46.343726 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eccedcc85e34f88b2394d19d19538f4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:46.344412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eccedcc85e34f88b2394d19d19538f4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:46.353950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301e9fb-6a76-4e88-8db4-82b08a4f746a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:46.361630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301e9fb-6a76-4e88-8db4-82b08a4f746a service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:46.381763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eccedcc85e34f88b2394d19d19538f4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:46.411448 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eccedcc85e34f88b2394d19d19538f4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:46.413649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 854/1700] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:46.414861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301e9fb-6a76-4e88-8db4-82b08a4f746a service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:46.450655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301e9fb-6a76-4e88-8db4-82b08a4f746a service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:46.464083 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420019-ad09-4744-ad9d-932d77530ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:46.465726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420019-ad09-4744-ad9d-932d77530ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:46.466129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420019-ad09-4744-ad9d-932d77530ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:46.466958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420019-ad09-4744-ad9d-932d77530ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:46.467838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0420019-ad09-4744-ad9d-932d77530ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:46.468208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0420019-ad09-4744-ad9d-932d77530ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:46.471148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0420019-ad09-4744-ad9d-932d77530ee5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:46.492287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 855/1701] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:46.504102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eccedcc85e34f88b2394d19d19538f4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:46.508031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573bfe-3ab0-4b0c-84ab-cb98a34222cf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:46.508614 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573bfe-3ab0-4b0c-84ab-cb98a34222cf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:46.508762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573bfe-3ab0-4b0c-84ab-cb98a34222cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:46.518025 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 847/1702] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:45 2022] DELETE /identity/v3/users/5eccedcc85e34f88b2394d19d19538f4 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:46.522337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:46.526391 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:46.585588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-89573bfe-3ab0-4b0c-84ab-cb98a34222cf None None] MFA Rules not processed for user `7b92f9048d654e4787d036f6adbd840b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:46.587586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-89573bfe-3ab0-4b0c-84ab-cb98a34222cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:46.709893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ed8f7-8f4f-49b4-aada-6c2ba5e7e4c9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:46.713978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 856/1703] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:46.716002 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db93828-27de-4428-a63c-231e036fdaf9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:46.716566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db93828-27de-4428-a63c-231e036fdaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:46.717917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db93828-27de-4428-a63c-231e036fdaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:46.720683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1c503-6278-48ff-977f-3b90cbf300b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:46.721315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c503-6278-48ff-977f-3b90cbf300b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:46.721609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c503-6278-48ff-977f-3b90cbf300b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:46.721895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c503-6278-48ff-977f-3b90cbf300b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:46.725565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1c503-6278-48ff-977f-3b90cbf300b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:46.733775 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1c503-6278-48ff-977f-3b90cbf300b2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:46.746881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0db93828-27de-4428-a63c-231e036fdaf9 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:46.751261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0db93828-27de-4428-a63c-231e036fdaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:46.763536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 857/1704] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:46.765450 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db93828-27de-4428-a63c-231e036fdaf9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:46.770337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0db93828-27de-4428-a63c-231e036fdaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:46.860935 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 848/1705] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:46 2022] POST /identity/v3/projects => generated 405 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:46.860935 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1c503-6278-48ff-977f-3b90cbf300b2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:46.866123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9fd1c503-6278-48ff-977f-3b90cbf300b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:46.973000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db93828-27de-4428-a63c-231e036fdaf9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:47.010075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1c503-6278-48ff-977f-3b90cbf300b2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:47.021124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc577-9a16-445b-9409-7f495ee4031e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:47.021965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc577-9a16-445b-9409-7f495ee4031e service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:47.022731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc577-9a16-445b-9409-7f495ee4031e service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:47.023741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc577-9a16-445b-9409-7f495ee4031e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:47.100103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b854c30-2f8c-477b-b05e-6fa3512570f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:47.100800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b854c30-2f8c-477b-b05e-6fa3512570f2 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:47.101072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b854c30-2f8c-477b-b05e-6fa3512570f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:47.101341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b854c30-2f8c-477b-b05e-6fa3512570f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:47.217798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dc577-9a16-445b-9409-7f495ee4031e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:47.221391 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dc577-9a16-445b-9409-7f495ee4031e service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:47.234555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b854c30-2f8c-477b-b05e-6fa3512570f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:47.239390 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b854c30-2f8c-477b-b05e-6fa3512570f2 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:47.239507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 849/1706] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:47.239507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc577-9a16-445b-9409-7f495ee4031e service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:47.262430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc577-9a16-445b-9409-7f495ee4031e service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:47.272739 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 858/1707] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:47.276622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f846598-7db2-4f2d-a4a6-0888501880cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:47.278921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f846598-7db2-4f2d-a4a6-0888501880cc admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:47.281393 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f846598-7db2-4f2d-a4a6-0888501880cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:47.282124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f846598-7db2-4f2d-a4a6-0888501880cc admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:47.282980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f846598-7db2-4f2d-a4a6-0888501880cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:47.286038 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f846598-7db2-4f2d-a4a6-0888501880cc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:47.385903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:47.425892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 850/1708] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:47 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:47.429263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b854c30-2f8c-477b-b05e-6fa3512570f2 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:47.462580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b854c30-2f8c-477b-b05e-6fa3512570f2 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:47.469513 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840c4a6-2f2d-4a0b-b9fc-57380da9a4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:47.470625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840c4a6-2f2d-4a0b-b9fc-57380da9a4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:47.471091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840c4a6-2f2d-4a0b-b9fc-57380da9a4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:47.471537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840c4a6-2f2d-4a0b-b9fc-57380da9a4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:47.472815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840c4a6-2f2d-4a0b-b9fc-57380da9a4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:47.476362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840c4a6-2f2d-4a0b-b9fc-57380da9a4b9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:47.529700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 859/1709] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:47.531097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f846598-7db2-4f2d-a4a6-0888501880cc admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:47.545027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f846598-7db2-4f2d-a4a6-0888501880cc admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:47.557148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a200a-f951-428c-9c41-03874b737e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:47.557924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a200a-f951-428c-9c41-03874b737e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:47.558268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a200a-f951-428c-9c41-03874b737e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:47.558621 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a200a-f951-428c-9c41-03874b737e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:47.559423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a200a-f951-428c-9c41-03874b737e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:47.561273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a200a-f951-428c-9c41-03874b737e87 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:47.595807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 851/1710] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:47.600257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840c4a6-2f2d-4a0b-b9fc-57380da9a4b9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:47.606555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a200a-f951-428c-9c41-03874b737e87 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:47.611703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e97a200a-f951-428c-9c41-03874b737e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:47.619109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840c4a6-2f2d-4a0b-b9fc-57380da9a4b9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:47.674353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a200a-f951-428c-9c41-03874b737e87 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:47.678364 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce5f28-8965-406f-bd7c-4b709da555e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:47.686445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5f28-8965-406f-bd7c-4b709da555e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:47.686445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5f28-8965-406f-bd7c-4b709da555e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:47.686445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5f28-8965-406f-bd7c-4b709da555e7 admin admin] PATH_INFO: `/v3/projects/775bda7feadc4e77bff4a509d59288fc/users/b03e066891d740b6a3eb587f99fd8f00/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:47.711475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:47.712844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:47.713299 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:47.713747 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] PATH_INFO: `/v3/projects/f9631fbd2d8849aeac168ac6e1040f9d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:47.717453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9631fbd2d8849aeac168ac6e1040f9d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:47.719606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:47.767058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce5f28-8965-406f-bd7c-4b709da555e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775bda7feadc4e77bff4a509d59288fc, user_id=b03e066891d740b6a3eb587f99fd8f00, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:47.770128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce5f28-8965-406f-bd7c-4b709da555e7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:47.872870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 860/1711] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:47 2022] PUT /identity/v3/projects/775bda7feadc4e77bff4a509d59288fc/users/b03e066891d740b6a3eb587f99fd8f00/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:23:47.878462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6f415-bbb2-4cb9-b0bf-b2862a7052a7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:47.878786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6f415-bbb2-4cb9-b0bf-b2862a7052a7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:47.881091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6f415-bbb2-4cb9-b0bf-b2862a7052a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:47.930387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a8e6f415-bbb2-4cb9-b0bf-b2862a7052a7 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:47.936907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a8e6f415-bbb2-4cb9-b0bf-b2862a7052a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:47.948994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9631fbd2d8849aeac168ac6e1040f9d', 'request_id': 'req-74575a6d-d714-4a66-bf43-b5581daf8995'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:47.979775 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9631fbd2d8849aeac168ac6e1040f9d', 'request_id': 'req-74575a6d-d714-4a66-bf43-b5581daf8995'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:48.042061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9631fbd2d8849aeac168ac6e1040f9d', 'request_id': 'req-74575a6d-d714-4a66-bf43-b5581daf8995'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:48.064508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] The token cache is being invalidate because project f9631fbd2d8849aeac168ac6e1040f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:23:48.065017 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:48.065873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:48.072443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 852/1712] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:23:47 2022] DELETE /identity/v3/projects/f9631fbd2d8849aeac168ac6e1040f9d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:48.073699 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:48.092807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 861/1713] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:48.093711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:48.125278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6f415-bbb2-4cb9-b0bf-b2862a7052a7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:48.127217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a8e6f415-bbb2-4cb9-b0bf-b2862a7052a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:48.135859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74575a6d-d714-4a66-bf43-b5581daf8995 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:48.166117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:48.167642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:48.168399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:48.168681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] PATH_INFO: `/v3/users/8f3c6d6e5d7c4dd2b084d583172e6ad4` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:48.171473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3c6d6e5d7c4dd2b084d583172e6ad4)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:48.174022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:48.285408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6f415-bbb2-4cb9-b0bf-b2862a7052a7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:48.303164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee88ec-a621-4e8d-bea3-9ac80ead8394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:48.303991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee88ec-a621-4e8d-bea3-9ac80ead8394 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:48.304244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee88ec-a621-4e8d-bea3-9ac80ead8394 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:48.304592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee88ec-a621-4e8d-bea3-9ac80ead8394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:48.329823 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee88ec-a621-4e8d-bea3-9ac80ead8394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:48.331973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee88ec-a621-4e8d-bea3-9ac80ead8394 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:48.361497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 862/1714] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:48.368519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca189b-1880-40a9-ad32-0bb78f891ba2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:48.368889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca189b-1880-40a9-ad32-0bb78f891ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:48.369236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca189b-1880-40a9-ad32-0bb78f891ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:48.428683 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d2ca189b-1880-40a9-ad32-0bb78f891ba2 None None] MFA Rules not processed for user `58d8aba7074e4a07b0e93107ea0b75cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:48.430167 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d2ca189b-1880-40a9-ad32-0bb78f891ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:48.487567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:48.536205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3c6d6e5d7c4dd2b084d583172e6ad4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:48.536995 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3c6d6e5d7c4dd2b084d583172e6ad4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:48.554163 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3c6d6e5d7c4dd2b084d583172e6ad4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:48.574407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 863/1715] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:48.574407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca189b-1880-40a9-ad32-0bb78f891ba2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:48.579937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3c6d6e5d7c4dd2b084d583172e6ad4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:48.588468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d2ca189b-1880-40a9-ad32-0bb78f891ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:48.652428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca189b-1880-40a9-ad32-0bb78f891ba2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:48.668579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:48.669268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:48.669575 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:48.669853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] PATH_INFO: `/v3/projects/2f9cd5aaf00d4baa9f55dd0a0060284b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:48.675712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3c6d6e5d7c4dd2b084d583172e6ad4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:48.681710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9cd5aaf00d4baa9f55dd0a0060284b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:48.684961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:48.686392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 853/1716] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:48 2022] DELETE /identity/v3/users/8f3c6d6e5d7c4dd2b084d583172e6ad4 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:48.687441 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:48.692050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:48.863207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9cd5aaf00d4baa9f55dd0a0060284b', 'request_id': 'req-369adbc1-a108-4d66-af97-0ed704066607'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:48.873158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb083f-f0c1-482a-af98-a243c7fe7bae admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:48.877918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9cd5aaf00d4baa9f55dd0a0060284b', 'request_id': 'req-369adbc1-a108-4d66-af97-0ed704066607'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:48.919207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9cd5aaf00d4baa9f55dd0a0060284b', 'request_id': 'req-369adbc1-a108-4d66-af97-0ed704066607'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:49.048326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fd70f-6852-414d-88bc-23dc667475f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:49.051825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd70f-6852-414d-88bc-23dc667475f9 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:49.052184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd70f-6852-414d-88bc-23dc667475f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:49.052506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd70f-6852-414d-88bc-23dc667475f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:49.053016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] The token cache is being invalidate because project 2f9cd5aaf00d4baa9f55dd0a0060284b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:23:49.053536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:49.055057 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:49.055156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-db2fd70f-6852-414d-88bc-23dc667475f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:49.056639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 864/1717] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:23:48 2022] DELETE /identity/v3/projects/2f9cd5aaf00d4baa9f55dd0a0060284b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:49.060619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:49.065714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:49.246988 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fd70f-6852-414d-88bc-23dc667475f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:49.248770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369adbc1-a108-4d66-af97-0ed704066607 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:49.249687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fd70f-6852-414d-88bc-23dc667475f9 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:49.257683 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d6b28-3677-4c30-9a57-a1b29b58b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:49.258436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d6b28-3677-4c30-9a57-a1b29b58b6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:49.259317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d6b28-3677-4c30-9a57-a1b29b58b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:49.259659 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d6b28-3677-4c30-9a57-a1b29b58b6bd admin admin] PATH_INFO: `/v3/users/00d3345dab98484cb19ec2353c1a6166` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:49.262582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d6b28-3677-4c30-9a57-a1b29b58b6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d3345dab98484cb19ec2353c1a6166)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:49.267432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d6b28-3677-4c30-9a57-a1b29b58b6bd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:49.275808 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 854/1718] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:49.728169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e50d6b28-3677-4c30-9a57-a1b29b58b6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d3345dab98484cb19ec2353c1a6166'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:49.732225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e50d6b28-3677-4c30-9a57-a1b29b58b6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d3345dab98484cb19ec2353c1a6166'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:49.794449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e50d6b28-3677-4c30-9a57-a1b29b58b6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d3345dab98484cb19ec2353c1a6166'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:49.809018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e50d6b28-3677-4c30-9a57-a1b29b58b6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d3345dab98484cb19ec2353c1a6166'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:49.814156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e50d6b28-3677-4c30-9a57-a1b29b58b6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d3345dab98484cb19ec2353c1a6166'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:49.919349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 865/1719] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:49 2022] DELETE /identity/v3/users/00d3345dab98484cb19ec2353c1a6166 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:23:50.143287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:50.604006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fd70f-6852-414d-88bc-23dc667475f9 service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:50.605569 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-db2fd70f-6852-414d-88bc-23dc667475f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:50.628702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fd70f-6852-414d-88bc-23dc667475f9 service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:50.727898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:50.802928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:50.803608 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:50.804446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:50.804783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] PATH_INFO: `/v3/projects/f8d43be5ee2b477a9d41c3f2e08b3500` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:50.807889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d43be5ee2b477a9d41c3f2e08b3500)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:50.811153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:50.947954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:50.954169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d43be5ee2b477a9d41c3f2e08b3500', 'request_id': 'req-752bc4a7-d911-423c-bb7c-cea41042ff6e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:50.966348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d43be5ee2b477a9d41c3f2e08b3500', 'request_id': 'req-752bc4a7-d911-423c-bb7c-cea41042ff6e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:51.030626 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d43be5ee2b477a9d41c3f2e08b3500', 'request_id': 'req-752bc4a7-d911-423c-bb7c-cea41042ff6e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:51.051146 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] The token cache is being invalidate because project f8d43be5ee2b477a9d41c3f2e08b3500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:23:51.055081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:51.060256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-752bc4a7-d911-423c-bb7c-cea41042ff6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:51.061311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 855/1720] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:23:50 2022] DELETE /identity/v3/projects/f8d43be5ee2b477a9d41c3f2e08b3500 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:51.065783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e6fa5-9311-457e-9203-026771b17637 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:51.066800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e6fa5-9311-457e-9203-026771b17637 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:51.067278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e6fa5-9311-457e-9203-026771b17637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:51.088946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456deeea-1cd1-4353-9770-b515a79db6df None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:51.089309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456deeea-1cd1-4353-9770-b515a79db6df None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:51.089815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456deeea-1cd1-4353-9770-b515a79db6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:51.129968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-491e6fa5-9311-457e-9203-026771b17637 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:51.132420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-491e6fa5-9311-457e-9203-026771b17637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:51.167564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-456deeea-1cd1-4353-9770-b515a79db6df None None] MFA Rules not processed for user `22c7c123b98b45cf8182ce553b0be9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:51.168873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-456deeea-1cd1-4353-9770-b515a79db6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:51.284621 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 866/1721] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:51.294652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549275c-eb8a-45c9-8ba8-a84fac6f7ad4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:51.295974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549275c-eb8a-45c9-8ba8-a84fac6f7ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:51.296260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549275c-eb8a-45c9-8ba8-a84fac6f7ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:51.347068 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4549275c-eb8a-45c9-8ba8-a84fac6f7ad4 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:51.350404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4549275c-eb8a-45c9-8ba8-a84fac6f7ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:51.350675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 856/1722] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:51.362506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2692a-a5de-4d03-8cae-1cff97f68b15 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:51.362787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2692a-a5de-4d03-8cae-1cff97f68b15 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:51.363061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2692a-a5de-4d03-8cae-1cff97f68b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:51.378077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 867/1723] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:23:51.384562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549275c-eb8a-45c9-8ba8-a84fac6f7ad4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:51.392023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7fd2692a-a5de-4d03-8cae-1cff97f68b15 None None] MFA Rules not processed for user `22c7c123b98b45cf8182ce553b0be9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:51.394690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7fd2692a-a5de-4d03-8cae-1cff97f68b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:51.397909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549275c-eb8a-45c9-8ba8-a84fac6f7ad4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:51.421467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 857/1724] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:51.428016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2692a-a5de-4d03-8cae-1cff97f68b15 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:51.429150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3bb3-97fe-43b4-8023-f191d2ba3a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:51.429339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7fd2692a-a5de-4d03-8cae-1cff97f68b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:51.435168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3bb3-97fe-43b4-8023-f191d2ba3a9f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:51.439079 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3bb3-97fe-43b4-8023-f191d2ba3a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:51.439557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3bb3-97fe-43b4-8023-f191d2ba3a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:51.440591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee3bb3-97fe-43b4-8023-f191d2ba3a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:51.442415 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee3bb3-97fe-43b4-8023-f191d2ba3a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:51.449478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee3bb3-97fe-43b4-8023-f191d2ba3a9f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:51.495420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 868/1725] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:23:51.499846 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3bb3-97fe-43b4-8023-f191d2ba3a9f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:51.534987 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3bb3-97fe-43b4-8023-f191d2ba3a9f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:51.555380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6011c-dcfd-4b51-92d3-5e1c072a13be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:51.559965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6011c-dcfd-4b51-92d3-5e1c072a13be admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:51.561783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6011c-dcfd-4b51-92d3-5e1c072a13be admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:51.562272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6011c-dcfd-4b51-92d3-5e1c072a13be admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:51.563731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6011c-dcfd-4b51-92d3-5e1c072a13be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:51.565938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6011c-dcfd-4b51-92d3-5e1c072a13be admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:51.600921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2692a-a5de-4d03-8cae-1cff97f68b15 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:51.612014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14168faa-2c64-4e77-b77c-fcb99b6ef467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:51.612669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14168faa-2c64-4e77-b77c-fcb99b6ef467 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:51.612990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14168faa-2c64-4e77-b77c-fcb99b6ef467 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:51.613187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14168faa-2c64-4e77-b77c-fcb99b6ef467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:51.628221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14168faa-2c64-4e77-b77c-fcb99b6ef467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:51.629875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14168faa-2c64-4e77-b77c-fcb99b6ef467 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:51.656221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 858/1726] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:51.656901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14168faa-2c64-4e77-b77c-fcb99b6ef467 service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:51.666859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-14168faa-2c64-4e77-b77c-fcb99b6ef467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:51.695942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14168faa-2c64-4e77-b77c-fcb99b6ef467 service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:51.708249 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:51.709334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:51.709334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:51.709565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] PATH_INFO: `/v3/projects/935b40f1587342a29ef02ee06443fea3` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:51.710674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935b40f1587342a29ef02ee06443fea3)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:51.713064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:51.730205 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 869/1727] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:51 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:51.731201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6011c-dcfd-4b51-92d3-5e1c072a13be admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:51.742504 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b5c6011c-dcfd-4b51-92d3-5e1c072a13be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:51.878570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935b40f1587342a29ef02ee06443fea3', 'request_id': 'req-1cdf86e6-3091-440e-8d8d-127179971f77'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:51.896067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935b40f1587342a29ef02ee06443fea3', 'request_id': 'req-1cdf86e6-3091-440e-8d8d-127179971f77'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:51.919586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6011c-dcfd-4b51-92d3-5e1c072a13be admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:51.971787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935b40f1587342a29ef02ee06443fea3', 'request_id': 'req-1cdf86e6-3091-440e-8d8d-127179971f77'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:51.990056 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] The token cache is being invalidate because project 935b40f1587342a29ef02ee06443fea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:23:51.990469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:51.992003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:51.994896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 859/1728] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:23:51 2022] DELETE /identity/v3/projects/935b40f1587342a29ef02ee06443fea3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:51.996248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:52.003566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:52.052038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:52.052480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.052766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.053037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] PATH_INFO: `/v3/users/faba40961d68471ebf78c012dcdf520c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.055175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faba40961d68471ebf78c012dcdf520c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:52.062573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:52.155649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:52.169937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf86e6-3091-440e-8d8d-127179971f77 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:52.188340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11118fe2-b4ac-4690-b04f-6e500ba98f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:52.194467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11118fe2-b4ac-4690-b04f-6e500ba98f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.194467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11118fe2-b4ac-4690-b04f-6e500ba98f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.194467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11118fe2-b4ac-4690-b04f-6e500ba98f95 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.194467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11118fe2-b4ac-4690-b04f-6e500ba98f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:52.195353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11118fe2-b4ac-4690-b04f-6e500ba98f95 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:52.294783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 860/1729] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:51 2022] POST /identity/v3/users => generated 289 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:52.296391 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02a42-1f9f-4d01-9b36-a750f6f3e72d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.296645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02a42-1f9f-4d01-9b36-a750f6f3e72d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.297190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02a42-1f9f-4d01-9b36-a750f6f3e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.312259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faba40961d68471ebf78c012dcdf520c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:52.313120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faba40961d68471ebf78c012dcdf520c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:52.321416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1cb02a42-1f9f-4d01-9b36-a750f6f3e72d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:52.322938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1cb02a42-1f9f-4d01-9b36-a750f6f3e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:52.332189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faba40961d68471ebf78c012dcdf520c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:52.333961 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 861/1730] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:52.335637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb02a42-1f9f-4d01-9b36-a750f6f3e72d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:52.337386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1cb02a42-1f9f-4d01-9b36-a750f6f3e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:52.340507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faba40961d68471ebf78c012dcdf520c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:52.345977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faba40961d68471ebf78c012dcdf520c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:52.353725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb02a42-1f9f-4d01-9b36-a750f6f3e72d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:52.359675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b2bb0-a9a5-4ca1-9c3d-e5ed41103c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:52.360612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2bb0-a9a5-4ca1-9c3d-e5ed41103c3e admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.361057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2bb0-a9a5-4ca1-9c3d-e5ed41103c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.361722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2bb0-a9a5-4ca1-9c3d-e5ed41103c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.363158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b2bb0-a9a5-4ca1-9c3d-e5ed41103c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:52.364787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b2bb0-a9a5-4ca1-9c3d-e5ed41103c3e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:52.377682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 862/1731] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:52.379710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96862e1-57c8-4c5c-a74e-1bca232fed7c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.379710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96862e1-57c8-4c5c-a74e-1bca232fed7c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.379710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96862e1-57c8-4c5c-a74e-1bca232fed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.407738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b96862e1-57c8-4c5c-a74e-1bca232fed7c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:52.409252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b96862e1-57c8-4c5c-a74e-1bca232fed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:52.422246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 870/1732] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:51 2022] DELETE /identity/v3/users/faba40961d68471ebf78c012dcdf520c => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:52.422246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:52.423617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 863/1733] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:52.425590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdee113-de9d-4535-a8bc-0a9f15bae20d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.425950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdee113-de9d-4535-a8bc-0a9f15bae20d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.426562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdee113-de9d-4535-a8bc-0a9f15bae20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.450873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-acdee113-de9d-4535-a8bc-0a9f15bae20d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:52.451059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-acdee113-de9d-4535-a8bc-0a9f15bae20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:52.533493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 864/1734] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:52.534773 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdee113-de9d-4535-a8bc-0a9f15bae20d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:52.548936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdee113-de9d-4535-a8bc-0a9f15bae20d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:52.556905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc0f9e-c510-4cea-b87a-5816329acc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:52.557380 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc0f9e-c510-4cea-b87a-5816329acc25 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.557729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc0f9e-c510-4cea-b87a-5816329acc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.558414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc0f9e-c510-4cea-b87a-5816329acc25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.559180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc0f9e-c510-4cea-b87a-5816329acc25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:52.559563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc0f9e-c510-4cea-b87a-5816329acc25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:52.559677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc196e4f-8432-4bd1-9480-70ce92b6c217 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:52.561678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc0f9e-c510-4cea-b87a-5816329acc25 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:52.572455 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ab2c-c29f-426b-bbc5-b20bc0a378c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:52.574227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ab2c-c29f-426b-bbc5-b20bc0a378c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.574518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ab2c-c29f-426b-bbc5-b20bc0a378c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.576039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ab2c-c29f-426b-bbc5-b20bc0a378c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.577738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 865/1735] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:52.582739 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2ab2c-c29f-426b-bbc5-b20bc0a378c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:52.583143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc0f9e-c510-4cea-b87a-5816329acc25 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:52.583372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2ab2c-c29f-426b-bbc5-b20bc0a378c7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:52.586340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f4bc0f9e-c510-4cea-b87a-5816329acc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:52.609865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 871/1736] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:52.639431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ab2c-c29f-426b-bbc5-b20bc0a378c7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:52.639431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2ab2c-c29f-426b-bbc5-b20bc0a378c7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:52.650629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb827dd-2094-4c87-8825-5a0241cbd417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:52.653870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb827dd-2094-4c87-8825-5a0241cbd417 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.655098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb827dd-2094-4c87-8825-5a0241cbd417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.655523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb827dd-2094-4c87-8825-5a0241cbd417 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.656831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb827dd-2094-4c87-8825-5a0241cbd417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:52.662631 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb827dd-2094-4c87-8825-5a0241cbd417 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:52.673905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc0f9e-c510-4cea-b87a-5816329acc25 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:52.678328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da95e17-2612-4aa2-81cd-7a4d07d938af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:52.679201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95e17-2612-4aa2-81cd-7a4d07d938af service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.679544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95e17-2612-4aa2-81cd-7a4d07d938af service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.679877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95e17-2612-4aa2-81cd-7a4d07d938af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.697701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da95e17-2612-4aa2-81cd-7a4d07d938af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:52.699608 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da95e17-2612-4aa2-81cd-7a4d07d938af service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:52.720116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 866/1737] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:52.721064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da95e17-2612-4aa2-81cd-7a4d07d938af service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:52.734398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da95e17-2612-4aa2-81cd-7a4d07d938af service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:52.741969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dea5b4-6227-4695-ac0c-7a2da44ffe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:52.742655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea5b4-6227-4695-ac0c-7a2da44ffe30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.743474 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea5b4-6227-4695-ac0c-7a2da44ffe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.743849 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea5b4-6227-4695-ac0c-7a2da44ffe30 admin admin] PATH_INFO: `/v3/projects/1201c83920184c6d899c9b8f3a82cfc1/users/1c530462d67c435c99ba4dc694641f98/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.768578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 872/1738] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:52 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:52.773813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb827dd-2094-4c87-8825-5a0241cbd417 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:52.778208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dea5b4-6227-4695-ac0c-7a2da44ffe30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1201c83920184c6d899c9b8f3a82cfc1, user_id=1c530462d67c435c99ba4dc694641f98, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:52.780933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dea5b4-6227-4695-ac0c-7a2da44ffe30 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:52.877137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 867/1739] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:52 2022] PUT /identity/v3/projects/1201c83920184c6d899c9b8f3a82cfc1/users/1c530462d67c435c99ba4dc694641f98/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:52.880499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76e289-a235-4ee5-bf81-632f6a5438b4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:52.880796 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76e289-a235-4ee5-bf81-632f6a5438b4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:52.881056 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76e289-a235-4ee5-bf81-632f6a5438b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:52.925650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb827dd-2094-4c87-8825-5a0241cbd417 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:52.976558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6d76e289-a235-4ee5-bf81-632f6a5438b4 None None] MFA Rules not processed for user `1c530462d67c435c99ba4dc694641f98`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:52.980365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6d76e289-a235-4ee5-bf81-632f6a5438b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:53.006844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:53.076511 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791a17e-3996-40b0-a227-6ecd5fe5adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:53.077228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791a17e-3996-40b0-a227-6ecd5fe5adb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:53.077602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791a17e-3996-40b0-a227-6ecd5fe5adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:53.077939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791a17e-3996-40b0-a227-6ecd5fe5adb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:53.078778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791a17e-3996-40b0-a227-6ecd5fe5adb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:53.088879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791a17e-3996-40b0-a227-6ecd5fe5adb1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:53.094986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:53.145512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 868/1740] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:53.145512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6062384-abd3-4e9e-9ba1-d34b452bef52 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:53.145512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6062384-abd3-4e9e-9ba1-d34b452bef52 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:53.145512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6062384-abd3-4e9e-9ba1-d34b452bef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:53.202340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f6062384-abd3-4e9e-9ba1-d34b452bef52 None None] MFA Rules not processed for user `b03e066891d740b6a3eb587f99fd8f00`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:53.203862 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f6062384-abd3-4e9e-9ba1-d34b452bef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:53.246018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 873/1741] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:52 2022] POST /identity/v3/users => generated 293 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:53.246871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791a17e-3996-40b0-a227-6ecd5fe5adb1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:53.277970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791a17e-3996-40b0-a227-6ecd5fe5adb1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:53.285931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb701d-9776-4c68-9ad4-073ccb13d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:53.286845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb701d-9776-4c68-9ad4-073ccb13d8ff admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:53.287529 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb701d-9776-4c68-9ad4-073ccb13d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:53.288562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb701d-9776-4c68-9ad4-073ccb13d8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:53.289385 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb701d-9776-4c68-9ad4-073ccb13d8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:53.293251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb701d-9776-4c68-9ad4-073ccb13d8ff admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:53.322305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 869/1742] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:53.324102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b413990-7515-4d7c-9736-2a871e638cbd None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:53.324403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b413990-7515-4d7c-9736-2a871e638cbd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:53.324674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b413990-7515-4d7c-9736-2a871e638cbd None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:53.327824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 870/1743] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 17 16:23:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:23:53.328809 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b413990-7515-4d7c-9736-2a871e638cbd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:53.363900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b413990-7515-4d7c-9736-2a871e638cbd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:53.372779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc14a5-444b-4639-b5b1-25e2faa2ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:53.373294 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc14a5-444b-4639-b5b1-25e2faa2ab3a admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:53.373716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc14a5-444b-4639-b5b1-25e2faa2ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:53.374040 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc14a5-444b-4639-b5b1-25e2faa2ab3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:53.374702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc14a5-444b-4639-b5b1-25e2faa2ab3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:53.376465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc14a5-444b-4639-b5b1-25e2faa2ab3a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:53.395993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 871/1744] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:53.398374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccd54-007f-4f77-857d-7396713d6ced None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:53.399000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccd54-007f-4f77-857d-7396713d6ced None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:53.400537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feccd54-007f-4f77-857d-7396713d6ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:53.445809 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8feccd54-007f-4f77-857d-7396713d6ced None None] MFA Rules not processed for user `7b92f9048d654e4787d036f6adbd840b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:53.449952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8feccd54-007f-4f77-857d-7396713d6ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:53.534595 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 874/1745] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:53 2022] POST /identity/v3/projects => generated 377 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:53.535792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb701d-9776-4c68-9ad4-073ccb13d8ff admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:53.542142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-20eb701d-9776-4c68-9ad4-073ccb13d8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:53.551813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 872/1746] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:53.554528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36a3e-e0c2-4d6d-add1-12c77574a47a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:53.554528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36a3e-e0c2-4d6d-add1-12c77574a47a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:53.554528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36a3e-e0c2-4d6d-add1-12c77574a47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:53.604069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-42e36a3e-e0c2-4d6d-add1-12c77574a47a None None] MFA Rules not processed for user `4ad54a22e6e747d9887c82bb62a923da`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:53.605496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-42e36a3e-e0c2-4d6d-add1-12c77574a47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:53.675743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:53.685719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb701d-9776-4c68-9ad4-073ccb13d8ff admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:53.690681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f6391-fdfd-4e26-8b7f-b6171c100a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:53.691638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f6391-fdfd-4e26-8b7f-b6171c100a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:53.691917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f6391-fdfd-4e26-8b7f-b6171c100a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:53.692186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f6391-fdfd-4e26-8b7f-b6171c100a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:53.692814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f6391-fdfd-4e26-8b7f-b6171c100a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:53.694830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f6391-fdfd-4e26-8b7f-b6171c100a22 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:53.718385 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 873/1747] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:53.719362 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e36a3e-e0c2-4d6d-add1-12c77574a47a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:53.742960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e36a3e-e0c2-4d6d-add1-12c77574a47a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:53.749520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f671ea8-5971-4b72-864b-6629bf1dae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:53.762640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f671ea8-5971-4b72-864b-6629bf1dae61 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:53.762640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f671ea8-5971-4b72-864b-6629bf1dae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:53.762640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f671ea8-5971-4b72-864b-6629bf1dae61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:53.763090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f671ea8-5971-4b72-864b-6629bf1dae61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:53.771603 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f671ea8-5971-4b72-864b-6629bf1dae61 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:53.804129 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 874/1748] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:53.805093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f671ea8-5971-4b72-864b-6629bf1dae61 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:53.822777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 875/1749] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:53 2022] POST /identity/v3/projects => generated 405 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:53.823447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f6391-fdfd-4e26-8b7f-b6171c100a22 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:53.828565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f671ea8-5971-4b72-864b-6629bf1dae61 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:53.983638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f6391-fdfd-4e26-8b7f-b6171c100a22 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:54.005830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5909e-fd3e-4633-bbcc-d89e708e463a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:54.006574 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5909e-fd3e-4633-bbcc-d89e708e463a service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:54.010787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5909e-fd3e-4633-bbcc-d89e708e463a service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:54.011749 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5909e-fd3e-4633-bbcc-d89e708e463a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:54.049001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9bcd-8bc7-423b-9bb8-bcf70fea5c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:54.049448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5909e-fd3e-4633-bbcc-d89e708e463a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:54.050838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9bcd-8bc7-423b-9bb8-bcf70fea5c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:54.053567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9bcd-8bc7-423b-9bb8-bcf70fea5c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:54.057182 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5909e-fd3e-4633-bbcc-d89e708e463a service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:54.057600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9bcd-8bc7-423b-9bb8-bcf70fea5c5c admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:54.064201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea9bcd-8bc7-423b-9bb8-bcf70fea5c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:54.066672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea9bcd-8bc7-423b-9bb8-bcf70fea5c5c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:54.091187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 876/1750] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:54.097873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5909e-fd3e-4633-bbcc-d89e708e463a service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:54.132984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5909e-fd3e-4633-bbcc-d89e708e463a service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:54.155294 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0804a-fce3-45e3-8d14-4cb5792632a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:54.155294 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0804a-fce3-45e3-8d14-4cb5792632a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:54.155294 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0804a-fce3-45e3-8d14-4cb5792632a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:54.155294 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0804a-fce3-45e3-8d14-4cb5792632a1 admin admin] PATH_INFO: `/v3/projects/3168322f58f9421f90aa5a46d8347b6b/users/6ab17f2c01a14c738b58497ef921f0ad/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:54.178020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0804a-fce3-45e3-8d14-4cb5792632a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3168322f58f9421f90aa5a46d8347b6b, user_id=6ab17f2c01a14c738b58497ef921f0ad, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:54.181596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0804a-fce3-45e3-8d14-4cb5792632a1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:54.250261 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 875/1751] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:53 2022] POST /identity/v3/users => generated 295 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:54.251381 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9bcd-8bc7-423b-9bb8-bcf70fea5c5c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:54.275847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 877/1752] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:54 2022] PUT /identity/v3/projects/3168322f58f9421f90aa5a46d8347b6b/users/6ab17f2c01a14c738b58497ef921f0ad/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:54.275847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0804a-fce3-45e3-8d14-4cb5792632a1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:54.277769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6dc0804a-fce3-45e3-8d14-4cb5792632a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:54.281636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9bcd-8bc7-423b-9bb8-bcf70fea5c5c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:54.478996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2ceb-0e5f-4be4-9fd7-b5a60e9b9826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:54.479824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2ceb-0e5f-4be4-9fd7-b5a60e9b9826 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:54.480202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2ceb-0e5f-4be4-9fd7-b5a60e9b9826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:54.481438 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2ceb-0e5f-4be4-9fd7-b5a60e9b9826 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:54.482386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e2ceb-0e5f-4be4-9fd7-b5a60e9b9826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:54.484813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e2ceb-0e5f-4be4-9fd7-b5a60e9b9826 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:54.488407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0804a-fce3-45e3-8d14-4cb5792632a1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:54.497211 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:54.497989 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:54.498427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:54.498737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] PATH_INFO: `/v3/projects/4dccf9be359341e0a60f47ab13ad4146` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:54.499954 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dccf9be359341e0a60f47ab13ad4146)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:54.502297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:54.607413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 876/1753] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:54 2022] POST /identity/v3/users => generated 309 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:54.608521 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2ceb-0e5f-4be4-9fd7-b5a60e9b9826 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:54.626376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:54.640043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2ceb-0e5f-4be4-9fd7-b5a60e9b9826 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:54.666223 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dccf9be359341e0a60f47ab13ad4146', 'request_id': 'req-024654ab-66a1-4ae3-8659-416b7c99399c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:54.685058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dccf9be359341e0a60f47ab13ad4146', 'request_id': 'req-024654ab-66a1-4ae3-8659-416b7c99399c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:54.697173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dccf9be359341e0a60f47ab13ad4146', 'request_id': 'req-024654ab-66a1-4ae3-8659-416b7c99399c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:54.765780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872dd69-c88b-4520-9aee-2a85d6554c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:54.766858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872dd69-c88b-4520-9aee-2a85d6554c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:54.767174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872dd69-c88b-4520-9aee-2a85d6554c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:54.767539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872dd69-c88b-4520-9aee-2a85d6554c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:54.768315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872dd69-c88b-4520-9aee-2a85d6554c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:54.770094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872dd69-c88b-4520-9aee-2a85d6554c89 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:54.789479 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 877/1754] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:54.791815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d8ba-03bc-40bc-b3e0-cf06103218fa None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:54.792195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d8ba-03bc-40bc-b3e0-cf06103218fa None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:54.792531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d8ba-03bc-40bc-b3e0-cf06103218fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:54.814458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:54.836374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] The token cache is being invalidate because project 4dccf9be359341e0a60f47ab13ad4146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:23:54.839122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:54.841148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:54.847295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 878/1755] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:23:54 2022] DELETE /identity/v3/projects/4dccf9be359341e0a60f47ab13ad4146 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:54.848631 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:54.851577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:54.873226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5e21d8ba-03bc-40bc-b3e0-cf06103218fa None None] MFA Rules not processed for user `6ab17f2c01a14c738b58497ef921f0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:54.874580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5e21d8ba-03bc-40bc-b3e0-cf06103218fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:54.916633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024654ab-66a1-4ae3-8659-416b7c99399c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:54.926034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f2b75-acb9-4466-a244-d6cff8337c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:54.926664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f2b75-acb9-4466-a244-d6cff8337c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:54.926936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f2b75-acb9-4466-a244-d6cff8337c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:54.927206 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f2b75-acb9-4466-a244-d6cff8337c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:54.927855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f2b75-acb9-4466-a244-d6cff8337c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:54.929640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f2b75-acb9-4466-a244-d6cff8337c22 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:54.948215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 879/1756] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:54.948215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f2b75-acb9-4466-a244-d6cff8337c22 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:54.951375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-526f2b75-acb9-4466-a244-d6cff8337c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:54.977949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f2b75-acb9-4466-a244-d6cff8337c22 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:54.988208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb05697-59cb-4f5c-9cb1-af4581786bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:54.989432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb05697-59cb-4f5c-9cb1-af4581786bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:54.989940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb05697-59cb-4f5c-9cb1-af4581786bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:54.990489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb05697-59cb-4f5c-9cb1-af4581786bcf admin admin] PATH_INFO: `/v3/projects/860642e036794477ab00f7bc67610c60/users/bc30a87dd4bb4992bc1bb478cef3db8d/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.010027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 878/1757] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:55.014539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21d8ba-03bc-40bc-b3e0-cf06103218fa None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:55.014789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb05697-59cb-4f5c-9cb1-af4581786bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=860642e036794477ab00f7bc67610c60, user_id=bc30a87dd4bb4992bc1bb478cef3db8d, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:55.014893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5e21d8ba-03bc-40bc-b3e0-cf06103218fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:55.014976 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb05697-59cb-4f5c-9cb1-af4581786bcf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:55.028490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21d8ba-03bc-40bc-b3e0-cf06103218fa None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:55.043180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:55.043180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.043180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.043180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] PATH_INFO: `/v3/users/f047918422af4cbe8713ce72c5bf6b91` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.045859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f047918422af4cbe8713ce72c5bf6b91)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:55.050068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:55.121141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 880/1758] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:54 2022] PUT /identity/v3/projects/860642e036794477ab00f7bc67610c60/users/bc30a87dd4bb4992bc1bb478cef3db8d/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:55.122719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb05697-59cb-4f5c-9cb1-af4581786bcf admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:55.261810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb05697-59cb-4f5c-9cb1-af4581786bcf admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:55.274880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49a05-84a1-46f5-979e-d8e000d23470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:55.275591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49a05-84a1-46f5-979e-d8e000d23470 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.276507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f047918422af4cbe8713ce72c5bf6b91'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:55.277054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49a05-84a1-46f5-979e-d8e000d23470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.277577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49a05-84a1-46f5-979e-d8e000d23470 admin admin] PATH_INFO: `/v3/projects/0e7a5f33fecb497485e1d3baafa8115d/users/df42a5cd648c461885884a5edfec0419/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.283125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f047918422af4cbe8713ce72c5bf6b91'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:55.307662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f047918422af4cbe8713ce72c5bf6b91'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:55.316193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f047918422af4cbe8713ce72c5bf6b91'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:55.330792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49a05-84a1-46f5-979e-d8e000d23470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7a5f33fecb497485e1d3baafa8115d, user_id=df42a5cd648c461885884a5edfec0419, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:55.330792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49a05-84a1-46f5-979e-d8e000d23470 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:55.429503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f047918422af4cbe8713ce72c5bf6b91'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:55.445733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 881/1759] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:55 2022] PUT /identity/v3/projects/0e7a5f33fecb497485e1d3baafa8115d/users/df42a5cd648c461885884a5edfec0419/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:55.446498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 879/1760] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:55 2022] DELETE /identity/v3/users/f047918422af4cbe8713ce72c5bf6b91 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:55.446601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377899b-969e-4147-82d9-c0ea22543899 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.447464 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:55.448373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377899b-969e-4147-82d9-c0ea22543899 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.448712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377899b-969e-4147-82d9-c0ea22543899 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.450305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 882/1761] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 17 16:23:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:23:55.451497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:55.453855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459588a-0aaf-43fc-ac49-2f5d4c1e4e1e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.454218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459588a-0aaf-43fc-ac49-2f5d4c1e4e1e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.455061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459588a-0aaf-43fc-ac49-2f5d4c1e4e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.494754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f459588a-0aaf-43fc-ac49-2f5d4c1e4e1e None None] MFA Rules not processed for user `b9d6d909e5e24923bbfc53fcf9975425`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:55.497837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f459588a-0aaf-43fc-ac49-2f5d4c1e4e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:55.581591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f546a3-a5e1-4b1e-9286-c32fdde79765 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:55.587504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6ada0-4288-4d11-9292-4ceb67061702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:55.588729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6ada0-4288-4d11-9292-4ceb67061702 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.589007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6ada0-4288-4d11-9292-4ceb67061702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.589271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6ada0-4288-4d11-9292-4ceb67061702 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.592561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 883/1762] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:55.598627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6ada0-4288-4d11-9292-4ceb67061702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:55.598765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459588a-0aaf-43fc-ac49-2f5d4c1e4e1e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:55.598765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f459588a-0aaf-43fc-ac49-2f5d4c1e4e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:55.598943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6ada0-4288-4d11-9292-4ceb67061702 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:55.608232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459588a-0aaf-43fc-ac49-2f5d4c1e4e1e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:55.613656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419e7f5-6c58-43d1-b607-a591b3ddfb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:55.614736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419e7f5-6c58-43d1-b607-a591b3ddfb14 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.615015 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419e7f5-6c58-43d1-b607-a591b3ddfb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.615280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419e7f5-6c58-43d1-b607-a591b3ddfb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.616115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419e7f5-6c58-43d1-b607-a591b3ddfb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:55.617970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419e7f5-6c58-43d1-b607-a591b3ddfb14 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:55.629338 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 884/1763] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:55.630724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2f88d-028a-4193-9edd-64b0134752d5 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.631007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2f88d-028a-4193-9edd-64b0134752d5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.631279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2f88d-028a-4193-9edd-64b0134752d5 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.633516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 885/1764] 10.222.0.40 () {54 vars in 961 bytes} [Wed Aug 17 16:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:23:55.634586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2f88d-028a-4193-9edd-64b0134752d5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:55.636862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3ec2f88d-028a-4193-9edd-64b0134752d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:55.654736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2f88d-028a-4193-9edd-64b0134752d5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:55.660138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6f3ad-770e-4cf4-935d-b6b0784295c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:55.661411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6f3ad-770e-4cf4-935d-b6b0784295c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.661411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6f3ad-770e-4cf4-935d-b6b0784295c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.661411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6f3ad-770e-4cf4-935d-b6b0784295c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.661983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6f3ad-770e-4cf4-935d-b6b0784295c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:55.664004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6f3ad-770e-4cf4-935d-b6b0784295c5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:55.680120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 886/1765] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:55.680120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b37111-f56a-4a57-a3fb-8a843dee303c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.680120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b37111-f56a-4a57-a3fb-8a843dee303c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.681132 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b37111-f56a-4a57-a3fb-8a843dee303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.718566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-16b37111-f56a-4a57-a3fb-8a843dee303c None None] MFA Rules not processed for user `4ad54a22e6e747d9887c82bb62a923da`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:55.718566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16b37111-f56a-4a57-a3fb-8a843dee303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:55.755554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 880/1766] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:55 2022] POST /identity/v3/projects => generated 385 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:55.760098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ba1e-3619-493c-b811-b41c9acd3894 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.761043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ba1e-3619-493c-b811-b41c9acd3894 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.761788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ba1e-3619-493c-b811-b41c9acd3894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.783142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 887/1767] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:55.784169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b37111-f56a-4a57-a3fb-8a843dee303c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:55.788873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9438ba1e-3619-493c-b811-b41c9acd3894 None None] MFA Rules not processed for user `58d8aba7074e4a07b0e93107ea0b75cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:55.792575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9438ba1e-3619-493c-b811-b41c9acd3894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:55.798303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b37111-f56a-4a57-a3fb-8a843dee303c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:55.865408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a5cbc-b683-4797-a2cd-ec6d03c25e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:55.866154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a5cbc-b683-4797-a2cd-ec6d03c25e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.866154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a5cbc-b683-4797-a2cd-ec6d03c25e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.871632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a5cbc-b683-4797-a2cd-ec6d03c25e73 admin admin] PATH_INFO: `/v3/projects/860642e036794477ab00f7bc67610c60/users/bc30a87dd4bb4992bc1bb478cef3db8d/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.871632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a5cbc-b683-4797-a2cd-ec6d03c25e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860642e036794477ab00f7bc67610c60, user_id=bc30a87dd4bb4992bc1bb478cef3db8d, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:55.872362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a5cbc-b683-4797-a2cd-ec6d03c25e73 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:55.893951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 888/1768] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:55 2022] PUT /identity/v3/projects/860642e036794477ab00f7bc67610c60/users/bc30a87dd4bb4992bc1bb478cef3db8d/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:55.895530 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16dc4-e640-417e-90ba-0c54ee28f8a5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:55.899781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16dc4-e640-417e-90ba-0c54ee28f8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:55.899781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16dc4-e640-417e-90ba-0c54ee28f8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:55.921284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:55.930445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-25e16dc4-e640-417e-90ba-0c54ee28f8a5 None None] MFA Rules not processed for user `da5e1da2196b4ff399921809f40d3002`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:55.932230 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-25e16dc4-e640-417e-90ba-0c54ee28f8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:55.939680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 881/1769] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:55.940507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438ba1e-3619-493c-b811-b41c9acd3894 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:55.957955 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438ba1e-3619-493c-b811-b41c9acd3894 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:55.978500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:56.024778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 889/1770] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Aug 17 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:56.025649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16dc4-e640-417e-90ba-0c54ee28f8a5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:56.067527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311c49a-2270-439a-9340-ba4c35c06ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:56.068508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311c49a-2270-439a-9340-ba4c35c06ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:56.069125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311c49a-2270-439a-9340-ba4c35c06ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:56.076672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311c49a-2270-439a-9340-ba4c35c06ab7 admin admin] PATH_INFO: `/v3/projects/0e7a5f33fecb497485e1d3baafa8115d/users/df42a5cd648c461885884a5edfec0419/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:56.079610 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311c49a-2270-439a-9340-ba4c35c06ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7a5f33fecb497485e1d3baafa8115d, user_id=df42a5cd648c461885884a5edfec0419, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:56.086218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311c49a-2270-439a-9340-ba4c35c06ab7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:56.107636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 882/1771] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:55 2022] PUT /identity/v3/projects/0e7a5f33fecb497485e1d3baafa8115d/users/df42a5cd648c461885884a5edfec0419/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:56.110775 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311c49a-2270-439a-9340-ba4c35c06ab7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:56.112099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7311c49a-2270-439a-9340-ba4c35c06ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:56.151511 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16dc4-e640-417e-90ba-0c54ee28f8a5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:56.208618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311c49a-2270-439a-9340-ba4c35c06ab7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:56.217406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11892ec8-1fe9-43d8-bf8f-b3316c05353c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:56.221449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11892ec8-1fe9-43d8-bf8f-b3316c05353c service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:56.221449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11892ec8-1fe9-43d8-bf8f-b3316c05353c service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:56.221449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11892ec8-1fe9-43d8-bf8f-b3316c05353c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:56.241662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11892ec8-1fe9-43d8-bf8f-b3316c05353c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:56.244184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11892ec8-1fe9-43d8-bf8f-b3316c05353c service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:56.254943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 883/1772] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:56.256479 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a915fe-2567-4c92-92ec-71ae236f9a96 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:56.256852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a915fe-2567-4c92-92ec-71ae236f9a96 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:56.257110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a915fe-2567-4c92-92ec-71ae236f9a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:56.271737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5c515-d045-44de-9c01-53a2d2435381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:56.272689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5c515-d045-44de-9c01-53a2d2435381 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:56.273761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5c515-d045-44de-9c01-53a2d2435381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:56.274341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5c515-d045-44de-9c01-53a2d2435381 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:56.275455 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5c515-d045-44de-9c01-53a2d2435381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:56.278195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5c515-d045-44de-9c01-53a2d2435381 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:56.297706 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d4a915fe-2567-4c92-92ec-71ae236f9a96 None None] MFA Rules not processed for user `bc30a87dd4bb4992bc1bb478cef3db8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:56.300355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d4a915fe-2567-4c92-92ec-71ae236f9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:56.406809 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 884/1773] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:56.407887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a915fe-2567-4c92-92ec-71ae236f9a96 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:56.439231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 890/1774] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:56 2022] POST /identity/v3/users => generated 299 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:56.445670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5c515-d045-44de-9c01-53a2d2435381 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:56.447564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-86d5c515-d045-44de-9c01-53a2d2435381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:56.483592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5c515-d045-44de-9c01-53a2d2435381 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:56.503073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:56.506332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:56.507615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:56.512555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] PATH_INFO: `/v3/projects/8f8aebd029f74537984a9abb20fa3f94` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:56.514903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8aebd029f74537984a9abb20fa3f94)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:56.519192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:56.572811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a915fe-2567-4c92-92ec-71ae236f9a96 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:56.579651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f4794-7f6f-422a-81b9-a9eb6d098814 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da5e1da2196b4ff399921809f40d3002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:56.580332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f4794-7f6f-422a-81b9-a9eb6d098814 service placement] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:56.580517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f4794-7f6f-422a-81b9-a9eb6d098814 service placement] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:56.580790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f4794-7f6f-422a-81b9-a9eb6d098814 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:56.582657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-661f4794-7f6f-422a-81b9-a9eb6d098814 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:56.602656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f4794-7f6f-422a-81b9-a9eb6d098814 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:56.602656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f4794-7f6f-422a-81b9-a9eb6d098814 service placement] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:56.616595 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 885/1775] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:56.618144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f4794-7f6f-422a-81b9-a9eb6d098814 service placement] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:56.620412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-661f4794-7f6f-422a-81b9-a9eb6d098814 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:56.713789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8aebd029f74537984a9abb20fa3f94', 'request_id': 'req-9af05f58-5d80-47b9-ad3b-e39b04007bee'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:56.767697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8aebd029f74537984a9abb20fa3f94', 'request_id': 'req-9af05f58-5d80-47b9-ad3b-e39b04007bee'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:56.774785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f4794-7f6f-422a-81b9-a9eb6d098814 service placement] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:56.815295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8aebd029f74537984a9abb20fa3f94', 'request_id': 'req-9af05f58-5d80-47b9-ad3b-e39b04007bee'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:56.890171 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73620f8-8145-4a79-b8d4-45f18f28860e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:56.901417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] The token cache is being invalidate because project 8f8aebd029f74537984a9abb20fa3f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:23:56.901417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:56.902249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:56.907551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 891/1776] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:23:56 2022] DELETE /identity/v3/projects/8f8aebd029f74537984a9abb20fa3f94 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:56.911780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:56.912611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73620f8-8145-4a79-b8d4-45f18f28860e service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:56.913001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73620f8-8145-4a79-b8d4-45f18f28860e service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:56.913279 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73620f8-8145-4a79-b8d4-45f18f28860e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:56.916235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:56.916936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f73620f8-8145-4a79-b8d4-45f18f28860e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:57.106648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73620f8-8145-4a79-b8d4-45f18f28860e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:57.109713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73620f8-8145-4a79-b8d4-45f18f28860e service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:57.152825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af05f58-5d80-47b9-ad3b-e39b04007bee admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:57.154124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 886/1777] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:57.161574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd803f-fccc-45f6-aad9-2c549a36ffa1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:57.161903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd803f-fccc-45f6-aad9-2c549a36ffa1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:57.166165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd803f-fccc-45f6-aad9-2c549a36ffa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:57.186812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8dd93-d924-473c-b695-7f8ae582989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:57.187463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8dd93-d924-473c-b695-7f8ae582989f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:57.189183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8dd93-d924-473c-b695-7f8ae582989f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:57.191014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8dd93-d924-473c-b695-7f8ae582989f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:57.193892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8dd93-d924-473c-b695-7f8ae582989f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:57.198994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8dd93-d924-473c-b695-7f8ae582989f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:57.268690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-50cd803f-fccc-45f6-aad9-2c549a36ffa1 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:57.268690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-50cd803f-fccc-45f6-aad9-2c549a36ffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:57.271985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 887/1778] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:57.279705 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 892/1779] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:57.291829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75f341-931d-4d1b-a26a-bce7a19ea243 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:57.292195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8dd93-d924-473c-b695-7f8ae582989f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:57.296898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75f341-931d-4d1b-a26a-bce7a19ea243 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:57.311677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75f341-931d-4d1b-a26a-bce7a19ea243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:57.344614 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8dd93-d924-473c-b695-7f8ae582989f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:57.378366 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4212d-a05e-4c3a-b810-072a1745a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:57.378961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4212d-a05e-4c3a-b810-072a1745a1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:57.379238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4212d-a05e-4c3a-b810-072a1745a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:57.379510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4212d-a05e-4c3a-b810-072a1745a1e0 admin admin] PATH_INFO: `/v3/projects/ad8de999ad8a41648c6327c454a08c05/users/0752df1d7c1f4ef1a02d40b7e8c2cb07/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:57.428540 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1b75f341-931d-4d1b-a26a-bce7a19ea243 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:57.443535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1b75f341-931d-4d1b-a26a-bce7a19ea243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:57.474106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4212d-a05e-4c3a-b810-072a1745a1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8de999ad8a41648c6327c454a08c05, user_id=0752df1d7c1f4ef1a02d40b7e8c2cb07, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:57.476510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 888/1780] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:57.485659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75f341-931d-4d1b-a26a-bce7a19ea243 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:57.485788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4212d-a05e-4c3a-b810-072a1745a1e0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:57.522646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75f341-931d-4d1b-a26a-bce7a19ea243 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:57.541225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c3ad-eb2c-474b-a022-3b249b9e1d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:57.541897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c3ad-eb2c-474b-a022-3b249b9e1d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:57.542175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c3ad-eb2c-474b-a022-3b249b9e1d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:57.546790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c3ad-eb2c-474b-a022-3b249b9e1d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:57.550651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594c3ad-eb2c-474b-a022-3b249b9e1d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:57.550988 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594c3ad-eb2c-474b-a022-3b249b9e1d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:57.552667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594c3ad-eb2c-474b-a022-3b249b9e1d66 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:57.582408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 893/1781] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:57 2022] PUT /identity/v3/projects/ad8de999ad8a41648c6327c454a08c05/users/0752df1d7c1f4ef1a02d40b7e8c2cb07/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:57.587524 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4212d-a05e-4c3a-b810-072a1745a1e0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:57.620774 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 889/1782] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:57.622219 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c3ad-eb2c-474b-a022-3b249b9e1d66 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:57.656068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c3ad-eb2c-474b-a022-3b249b9e1d66 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:57.737689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:57.877748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f1dd-c858-4a2e-8954-f6c4e22029d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:57.878378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f1dd-c858-4a2e-8954-f6c4e22029d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:57.878674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f1dd-c858-4a2e-8954-f6c4e22029d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:57.878925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f1dd-c858-4a2e-8954-f6c4e22029d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:57.879560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f1dd-c858-4a2e-8954-f6c4e22029d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:57.881531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f1dd-c858-4a2e-8954-f6c4e22029d0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:57.892973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4212d-a05e-4c3a-b810-072a1745a1e0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:57.908188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98902e-3c36-4c1b-92bf-606a5b936239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:57.908882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98902e-3c36-4c1b-92bf-606a5b936239 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:57.909174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98902e-3c36-4c1b-92bf-606a5b936239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:57.909472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98902e-3c36-4c1b-92bf-606a5b936239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:57.910129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98902e-3c36-4c1b-92bf-606a5b936239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:57.911868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98902e-3c36-4c1b-92bf-606a5b936239 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:57.942475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 894/1783] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:57.947195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98902e-3c36-4c1b-92bf-606a5b936239 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:57.961906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98902e-3c36-4c1b-92bf-606a5b936239 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:57.967300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d518-b386-4933-aede-abea161d4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:57.968112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d518-b386-4933-aede-abea161d4aee admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:57.968623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d518-b386-4933-aede-abea161d4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:57.969006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d518-b386-4933-aede-abea161d4aee admin admin] PATH_INFO: `/v3/projects/ad8de999ad8a41648c6327c454a08c05/users/0752df1d7c1f4ef1a02d40b7e8c2cb07/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:57.971125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d518-b386-4933-aede-abea161d4aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8de999ad8a41648c6327c454a08c05, user_id=0752df1d7c1f4ef1a02d40b7e8c2cb07, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:57.973973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d518-b386-4933-aede-abea161d4aee admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:58.001163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 895/1784] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:57 2022] PUT /identity/v3/projects/ad8de999ad8a41648c6327c454a08c05/users/0752df1d7c1f4ef1a02d40b7e8c2cb07/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:58.011707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1683-00a5-4c70-9d71-d922eed7d439 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:58.012061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1683-00a5-4c70-9d71-d922eed7d439 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:58.012382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1683-00a5-4c70-9d71-d922eed7d439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:58.056709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f25c1683-00a5-4c70-9d71-d922eed7d439 None None] MFA Rules not processed for user `0752df1d7c1f4ef1a02d40b7e8c2cb07`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:58.058746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f25c1683-00a5-4c70-9d71-d922eed7d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:58.120530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 890/1785] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:57 2022] POST /identity/v3/projects => generated 383 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:58.126059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f1dd-c858-4a2e-8954-f6c4e22029d0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:58.166037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 896/1786] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:58.193120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c1683-00a5-4c70-9d71-d922eed7d439 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:58.194889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f25c1683-00a5-4c70-9d71-d922eed7d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:58.266384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:58.274961 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f1dd-c858-4a2e-8954-f6c4e22029d0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:58.281123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026c78-d80d-4a4a-a52a-4e6d7b3c5f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:58.283158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026c78-d80d-4a4a-a52a-4e6d7b3c5f04 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:58.283526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026c78-d80d-4a4a-a52a-4e6d7b3c5f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:58.283921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026c78-d80d-4a4a-a52a-4e6d7b3c5f04 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:58.284662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026c78-d80d-4a4a-a52a-4e6d7b3c5f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:58.287937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026c78-d80d-4a4a-a52a-4e6d7b3c5f04 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:58.351147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c1683-00a5-4c70-9d71-d922eed7d439 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:58.458356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad67b0-dc46-4363-adbb-b1475dfae795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:58.458744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 891/1787] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:58 2022] POST /identity/v3/users => generated 292 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:58.458833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad67b0-dc46-4363-adbb-b1475dfae795 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:58.458833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad67b0-dc46-4363-adbb-b1475dfae795 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:58.458833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad67b0-dc46-4363-adbb-b1475dfae795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:58.459038 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026c78-d80d-4a4a-a52a-4e6d7b3c5f04 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:58.476454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026c78-d80d-4a4a-a52a-4e6d7b3c5f04 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:58.490244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcb91e-1f01-4188-99b1-7705fe40dd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:58.491206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcb91e-1f01-4188-99b1-7705fe40dd62 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:58.491584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcb91e-1f01-4188-99b1-7705fe40dd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:58.491953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcb91e-1f01-4188-99b1-7705fe40dd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:58.492741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcb91e-1f01-4188-99b1-7705fe40dd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:58.494499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcb91e-1f01-4188-99b1-7705fe40dd62 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:58.519170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 892/1788] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:23:58.527039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcb91e-1f01-4188-99b1-7705fe40dd62 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:58.540018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcb91e-1f01-4188-99b1-7705fe40dd62 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:58.552337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f65da-3cef-4888-91bb-e4d891275412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:58.553025 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f65da-3cef-4888-91bb-e4d891275412 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:58.553309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f65da-3cef-4888-91bb-e4d891275412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:58.553671 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f65da-3cef-4888-91bb-e4d891275412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:58.554361 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f65da-3cef-4888-91bb-e4d891275412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:58.557152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f65da-3cef-4888-91bb-e4d891275412 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:58.570934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 893/1789] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:23:58.574928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f65da-3cef-4888-91bb-e4d891275412 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:58.583888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad67b0-dc46-4363-adbb-b1475dfae795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:58.588366 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad67b0-dc46-4363-adbb-b1475dfae795 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:58.589162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f65da-3cef-4888-91bb-e4d891275412 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:58.595043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad76a-0515-4164-be5c-ea5c835cab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:58.595620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad76a-0515-4164-be5c-ea5c835cab8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:58.595962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad76a-0515-4164-be5c-ea5c835cab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:58.596339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad76a-0515-4164-be5c-ea5c835cab8e admin admin] PATH_INFO: `/v3/projects/494c7b56f55f4011a7048f43ec0b8189/users/af8b6a4c841442abbbe4f841d8536b86/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:58.625735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 897/1790] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:58.653838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:58.667635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ad76a-0515-4164-be5c-ea5c835cab8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=494c7b56f55f4011a7048f43ec0b8189, user_id=af8b6a4c841442abbbe4f841d8536b86, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:58.677148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ad76a-0515-4164-be5c-ea5c835cab8e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:58.692547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad67b0-dc46-4363-adbb-b1475dfae795 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:58.715598 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad67b0-dc46-4363-adbb-b1475dfae795 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:58.730187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72854c9f-64cd-462c-afaf-eb5f30c90860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:58.732938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854c9f-64cd-462c-afaf-eb5f30c90860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:58.733318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854c9f-64cd-462c-afaf-eb5f30c90860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:58.733710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854c9f-64cd-462c-afaf-eb5f30c90860 admin admin] PATH_INFO: `/v3/users/6ab17f2c01a14c738b58497ef921f0ad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:58.744198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72854c9f-64cd-462c-afaf-eb5f30c90860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab17f2c01a14c738b58497ef921f0ad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:58.752298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72854c9f-64cd-462c-afaf-eb5f30c90860 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:58.783805 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 894/1791] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:58 2022] PUT /identity/v3/projects/494c7b56f55f4011a7048f43ec0b8189/users/af8b6a4c841442abbbe4f841d8536b86/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:58.795707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8feadf-97b2-4971-8fd5-6e2bd65bd3db None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:58.795972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8feadf-97b2-4971-8fd5-6e2bd65bd3db None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:58.796300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8feadf-97b2-4971-8fd5-6e2bd65bd3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:58.829980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-bd8feadf-97b2-4971-8fd5-6e2bd65bd3db None None] MFA Rules not processed for user `af8b6a4c841442abbbe4f841d8536b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:58.831235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bd8feadf-97b2-4971-8fd5-6e2bd65bd3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:58.916332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 895/1792] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:58.917678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d81584-e0e0-4f6f-8eca-0036296b65f8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:58.917789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d81584-e0e0-4f6f-8eca-0036296b65f8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:58.918020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d81584-e0e0-4f6f-8eca-0036296b65f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:58.962647 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f5d81584-e0e0-4f6f-8eca-0036296b65f8 None None] MFA Rules not processed for user `df42a5cd648c461885884a5edfec0419`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:58.965283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f5d81584-e0e0-4f6f-8eca-0036296b65f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:59.038602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-72854c9f-64cd-462c-afaf-eb5f30c90860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab17f2c01a14c738b58497ef921f0ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:59.040603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-72854c9f-64cd-462c-afaf-eb5f30c90860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab17f2c01a14c738b58497ef921f0ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:59.060791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 896/1793] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:58 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:59.065183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-72854c9f-64cd-462c-afaf-eb5f30c90860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab17f2c01a14c738b58497ef921f0ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:59.067943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d81584-e0e0-4f6f-8eca-0036296b65f8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:59.076920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-72854c9f-64cd-462c-afaf-eb5f30c90860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab17f2c01a14c738b58497ef921f0ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:59.078030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-72854c9f-64cd-462c-afaf-eb5f30c90860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab17f2c01a14c738b58497ef921f0ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:59.206732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 898/1794] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:58 2022] DELETE /identity/v3/users/6ab17f2c01a14c738b58497ef921f0ad => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:23:59.212491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd94f-8211-4d93-b406-0f453eb17b07 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:59.213114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd94f-8211-4d93-b406-0f453eb17b07 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:59.213576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd94f-8211-4d93-b406-0f453eb17b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:59.255230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d81584-e0e0-4f6f-8eca-0036296b65f8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:59.274743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ad5bd94f-8211-4d93-b406-0f453eb17b07 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:59.278349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ad5bd94f-8211-4d93-b406-0f453eb17b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:59.398004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 899/1795] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:59.418465 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bd94f-8211-4d93-b406-0f453eb17b07 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:59.420325 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ad5bd94f-8211-4d93-b406-0f453eb17b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:59.421230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf621a83-2214-427e-9199-491f091cdf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:59.422086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621a83-2214-427e-9199-491f091cdf2a admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:59.422425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621a83-2214-427e-9199-491f091cdf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:59.422782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621a83-2214-427e-9199-491f091cdf2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:59.423574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf621a83-2214-427e-9199-491f091cdf2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:59.426180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf621a83-2214-427e-9199-491f091cdf2a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:59.515770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bd94f-8211-4d93-b406-0f453eb17b07 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:59.520478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e1b2d-8714-480f-9b3d-495f2c79ace2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:59.521737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e1b2d-8714-480f-9b3d-495f2c79ace2 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:59.522035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e1b2d-8714-480f-9b3d-495f2c79ace2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:59.522312 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e1b2d-8714-480f-9b3d-495f2c79ace2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:59.538770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 897/1796] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:59 2022] POST /identity/v3/projects => generated 381 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:59.543601 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf621a83-2214-427e-9199-491f091cdf2a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:59.550265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cf621a83-2214-427e-9199-491f091cdf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:59.555242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e1b2d-8714-480f-9b3d-495f2c79ace2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:59.557592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e1b2d-8714-480f-9b3d-495f2c79ace2 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:59.575921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 900/1797] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:59.686051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf621a83-2214-427e-9199-491f091cdf2a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:59.696670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cdd87-874d-49ed-98a2-191f454ac643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:59.697599 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cdd87-874d-49ed-98a2-191f454ac643 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:59.698398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cdd87-874d-49ed-98a2-191f454ac643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:59.698722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cdd87-874d-49ed-98a2-191f454ac643 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:59.699360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cdd87-874d-49ed-98a2-191f454ac643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:59.701702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cdd87-874d-49ed-98a2-191f454ac643 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:59.811114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 898/1798] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:59 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:23:59.815264 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e1b2d-8714-480f-9b3d-495f2c79ace2 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:59.825776 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e1b2d-8714-480f-9b3d-495f2c79ace2 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:59.831201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72cded-66cf-41cc-adab-03aa88d55bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:59.834185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72cded-66cf-41cc-adab-03aa88d55bab admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:59.834185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72cded-66cf-41cc-adab-03aa88d55bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:59.834185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72cded-66cf-41cc-adab-03aa88d55bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:59.834185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72cded-66cf-41cc-adab-03aa88d55bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:59.835386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72cded-66cf-41cc-adab-03aa88d55bab admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:59.846856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 901/1799] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:59.851422 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cdd87-874d-49ed-98a2-191f454ac643 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:59.864574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cdd87-874d-49ed-98a2-191f454ac643 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:59.870229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc1ab7-dd2f-4a0c-b574-31a66ba65b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:59.870902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1ab7-dd2f-4a0c-b574-31a66ba65b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:59.871241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1ab7-dd2f-4a0c-b574-31a66ba65b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:59.871509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc1ab7-dd2f-4a0c-b574-31a66ba65b85 admin admin] PATH_INFO: `/v3/projects/012ba3fcf9bc41508753e6253bbd4ccb/users/2f7b88f3b8dd4005a5ef257ef14d3689/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:59.908675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc1ab7-dd2f-4a0c-b574-31a66ba65b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012ba3fcf9bc41508753e6253bbd4ccb, user_id=2f7b88f3b8dd4005a5ef257ef14d3689, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:59.916186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc1ab7-dd2f-4a0c-b574-31a66ba65b85 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:00.049235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 899/1800] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:59 2022] PUT /identity/v3/projects/012ba3fcf9bc41508753e6253bbd4ccb/users/2f7b88f3b8dd4005a5ef257ef14d3689/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:00.052001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72cded-66cf-41cc-adab-03aa88d55bab admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:00.066775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72cded-66cf-41cc-adab-03aa88d55bab admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:00.130634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123dff7-2b2d-4900-8a6b-22fe215d66ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:00.131390 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123dff7-2b2d-4900-8a6b-22fe215d66ea admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:00.131746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123dff7-2b2d-4900-8a6b-22fe215d66ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:00.132087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123dff7-2b2d-4900-8a6b-22fe215d66ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:00.135405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123dff7-2b2d-4900-8a6b-22fe215d66ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:00.137027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123dff7-2b2d-4900-8a6b-22fe215d66ea admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:00.154052 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 902/1801] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:00.158116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc1ab7-dd2f-4a0c-b574-31a66ba65b85 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:00.170037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123dff7-2b2d-4900-8a6b-22fe215d66ea admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:00.181422 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc1ab7-dd2f-4a0c-b574-31a66ba65b85 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:00.183313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3123dff7-2b2d-4900-8a6b-22fe215d66ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:00.190829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:00.203793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ba2e2-1b63-4bde-a8bd-a435f45524c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:00.203793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ba2e2-1b63-4bde-a8bd-a435f45524c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:00.203793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ba2e2-1b63-4bde-a8bd-a435f45524c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:00.203793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ba2e2-1b63-4bde-a8bd-a435f45524c0 admin admin] PATH_INFO: `/v3/projects/012ba3fcf9bc41508753e6253bbd4ccb/users/2f7b88f3b8dd4005a5ef257ef14d3689/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:00.206700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ba2e2-1b63-4bde-a8bd-a435f45524c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012ba3fcf9bc41508753e6253bbd4ccb, user_id=2f7b88f3b8dd4005a5ef257ef14d3689, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:00.210324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ba2e2-1b63-4bde-a8bd-a435f45524c0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:00.210885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123dff7-2b2d-4900-8a6b-22fe215d66ea admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:00.218869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:00.219617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:00.220457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:00.220901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] PATH_INFO: `/v3/projects/3168322f58f9421f90aa5a46d8347b6b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:00.221260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 900/1802] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:00 2022] PUT /identity/v3/projects/012ba3fcf9bc41508753e6253bbd4ccb/users/2f7b88f3b8dd4005a5ef257ef14d3689/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:00.222849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3168322f58f9421f90aa5a46d8347b6b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:00.227299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:00.233207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de76b7-bc4d-458d-b373-9be97ce3765a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:00.233514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de76b7-bc4d-458d-b373-9be97ce3765a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:00.233788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de76b7-bc4d-458d-b373-9be97ce3765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:00.283942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-42de76b7-bc4d-458d-b373-9be97ce3765a None None] MFA Rules not processed for user `2f7b88f3b8dd4005a5ef257ef14d3689`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:00.285985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-42de76b7-bc4d-458d-b373-9be97ce3765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:00.374617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 901/1803] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:00.386846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de76b7-bc4d-458d-b373-9be97ce3765a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:00.389118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-42de76b7-bc4d-458d-b373-9be97ce3765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:00.405795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3168322f58f9421f90aa5a46d8347b6b', 'request_id': 'req-6efbdcf2-df6d-454c-8aed-78281ab5fd84'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:00.429456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3168322f58f9421f90aa5a46d8347b6b', 'request_id': 'req-6efbdcf2-df6d-454c-8aed-78281ab5fd84'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:00.456873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3168322f58f9421f90aa5a46d8347b6b', 'request_id': 'req-6efbdcf2-df6d-454c-8aed-78281ab5fd84'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:00.528282 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de76b7-bc4d-458d-b373-9be97ce3765a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:00.564687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:00.631835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] The token cache is being invalidate because project 3168322f58f9421f90aa5a46d8347b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:00.631835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:00.632477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6efbdcf2-df6d-454c-8aed-78281ab5fd84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:00.638909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 903/1804] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:00 2022] DELETE /identity/v3/projects/3168322f58f9421f90aa5a46d8347b6b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:00.640459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ee40-ac1e-4233-b2a0-9c8241404bf0 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:00.641817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ee40-ac1e-4233-b2a0-9c8241404bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:00.644904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ee40-ac1e-4233-b2a0-9c8241404bf0 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:00.653060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 904/1805] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 17 16:24:00 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:24:00.659774 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7ee40-ac1e-4233-b2a0-9c8241404bf0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:00.671078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0ec7ee40-ac1e-4233-b2a0-9c8241404bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:00.682085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92912ba4-99b4-498c-8513-2701d7966757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:00.682970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92912ba4-99b4-498c-8513-2701d7966757 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:00.683262 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92912ba4-99b4-498c-8513-2701d7966757 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:00.683537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92912ba4-99b4-498c-8513-2701d7966757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:00.685505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-92912ba4-99b4-498c-8513-2701d7966757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:00.826835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7ee40-ac1e-4233-b2a0-9c8241404bf0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:00.840423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92912ba4-99b4-498c-8513-2701d7966757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:00.842042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92912ba4-99b4-498c-8513-2701d7966757 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:00.846325 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:00.847124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:00.847456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:00.847833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] PATH_INFO: `/v3/users/0752df1d7c1f4ef1a02d40b7e8c2cb07` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:00.849874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0752df1d7c1f4ef1a02d40b7e8c2cb07)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:00.853210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:00.854966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 902/1806] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:00.857098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90027ec-149d-46d8-9d3b-23dd7266af25 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:00.857489 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90027ec-149d-46d8-9d3b-23dd7266af25 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:00.858520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90027ec-149d-46d8-9d3b-23dd7266af25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:00.932033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c90027ec-149d-46d8-9d3b-23dd7266af25 None None] MFA Rules not processed for user `da5e1da2196b4ff399921809f40d3002`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:00.934914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c90027ec-149d-46d8-9d3b-23dd7266af25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:01.022099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 903/1807] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 17 16:24:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:01.023052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90027ec-149d-46d8-9d3b-23dd7266af25 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:01.024884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c90027ec-149d-46d8-9d3b-23dd7266af25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:01.044618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90027ec-149d-46d8-9d3b-23dd7266af25 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:01.048385 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544687-e101-494b-b7f0-5ed75d52e0f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:01.049011 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544687-e101-494b-b7f0-5ed75d52e0f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:01.049291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544687-e101-494b-b7f0-5ed75d52e0f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:01.049607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544687-e101-494b-b7f0-5ed75d52e0f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:01.051461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-84544687-e101-494b-b7f0-5ed75d52e0f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:01.115970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84544687-e101-494b-b7f0-5ed75d52e0f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:01.118033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84544687-e101-494b-b7f0-5ed75d52e0f8 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:01.128100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 904/1808] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:01.128938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544687-e101-494b-b7f0-5ed75d52e0f8 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:01.130458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-84544687-e101-494b-b7f0-5ed75d52e0f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:01.130867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0752df1d7c1f4ef1a02d40b7e8c2cb07'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:01.131765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0752df1d7c1f4ef1a02d40b7e8c2cb07'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:01.147762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544687-e101-494b-b7f0-5ed75d52e0f8 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:01.147901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0752df1d7c1f4ef1a02d40b7e8c2cb07'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:01.151700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda46f16-296a-45ca-b5c6-2b9918c4cd03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da5e1da2196b4ff399921809f40d3002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:01.152318 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda46f16-296a-45ca-b5c6-2b9918c4cd03 service placement] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:01.152592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda46f16-296a-45ca-b5c6-2b9918c4cd03 service placement] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:01.152858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda46f16-296a-45ca-b5c6-2b9918c4cd03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:01.154746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-dda46f16-296a-45ca-b5c6-2b9918c4cd03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:01.157632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0752df1d7c1f4ef1a02d40b7e8c2cb07'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:01.158958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0752df1d7c1f4ef1a02d40b7e8c2cb07'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:01.167838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda46f16-296a-45ca-b5c6-2b9918c4cd03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:01.169518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda46f16-296a-45ca-b5c6-2b9918c4cd03 service placement] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:01.181996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 905/1809] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:01.251993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda46f16-296a-45ca-b5c6-2b9918c4cd03 service placement] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:01.258296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-dda46f16-296a-45ca-b5c6-2b9918c4cd03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:01.264844 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 905/1810] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:00 2022] DELETE /identity/v3/users/0752df1d7c1f4ef1a02d40b7e8c2cb07 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:01.275719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda46f16-296a-45ca-b5c6-2b9918c4cd03 service placement] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:01.338230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94681d4-f408-44f3-891d-b1a441a4896e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:01.338966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94681d4-f408-44f3-891d-b1a441a4896e service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:01.339108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94681d4-f408-44f3-891d-b1a441a4896e service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:01.339378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94681d4-f408-44f3-891d-b1a441a4896e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:01.341639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b94681d4-f408-44f3-891d-b1a441a4896e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:01.433873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94681d4-f408-44f3-891d-b1a441a4896e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:01.435560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94681d4-f408-44f3-891d-b1a441a4896e service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:01.448228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 906/1811] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:01.590138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:01.591432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:01.699007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16212448-895d-4395-9c53-4b9aa45514a0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:01.713169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:01.713912 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:01.714196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:01.714471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] PATH_INFO: `/v3/users/b03e066891d740b6a3eb587f99fd8f00` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:01.715711 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03e066891d740b6a3eb587f99fd8f00)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:01.718005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:01.963594 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03e066891d740b6a3eb587f99fd8f00'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:01.964809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03e066891d740b6a3eb587f99fd8f00'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:01.993562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03e066891d740b6a3eb587f99fd8f00'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:02.021735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03e066891d740b6a3eb587f99fd8f00'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:02.022806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03e066891d740b6a3eb587f99fd8f00'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:02.143069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 906/1812] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:01 2022] DELETE /identity/v3/users/b03e066891d740b6a3eb587f99fd8f00 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:02.474646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:02.480047 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e4746-3f12-4ac2-9072-15e2b7e96ee7 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:02.484635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e4746-3f12-4ac2-9072-15e2b7e96ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:02.484635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e4746-3f12-4ac2-9072-15e2b7e96ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:02.585900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ff6e4746-3f12-4ac2-9072-15e2b7e96ee7 None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:02.588169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ff6e4746-3f12-4ac2-9072-15e2b7e96ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:02.693683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 907/1813] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:24:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:02.869949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:02.870398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:02.875417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:03.000902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0474a-045c-448b-818b-724c6293473f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:03.017258 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e4746-3f12-4ac2-9072-15e2b7e96ee7 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:03.019942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ff6e4746-3f12-4ac2-9072-15e2b7e96ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:03.021737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:03.025579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:03.026253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:03.026744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] PATH_INFO: `/v3/projects/775bda7feadc4e77bff4a509d59288fc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:03.042216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=775bda7feadc4e77bff4a509d59288fc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:03.045497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e4746-3f12-4ac2-9072-15e2b7e96ee7 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:03.048854 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:03.054687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:03.056104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:03.056379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:03.056645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] PATH_INFO: `/v3/projects/ad8de999ad8a41648c6327c454a08c05` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:03.058822 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8de999ad8a41648c6327c454a08c05)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:03.060768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:03.228032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775bda7feadc4e77bff4a509d59288fc', 'request_id': 'req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.232745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775bda7feadc4e77bff4a509d59288fc', 'request_id': 'req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.262490 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775bda7feadc4e77bff4a509d59288fc', 'request_id': 'req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.289028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8de999ad8a41648c6327c454a08c05', 'request_id': 'req-8a23036d-897c-4ecf-8f09-b155505884fa'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.310672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8de999ad8a41648c6327c454a08c05', 'request_id': 'req-8a23036d-897c-4ecf-8f09-b155505884fa'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.366864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] The token cache is being invalidate because project 775bda7feadc4e77bff4a509d59288fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:03.367176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.368569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.374219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 907/1814] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:02 2022] DELETE /identity/v3/projects/775bda7feadc4e77bff4a509d59288fc => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:03.375012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:03.376947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:03.457137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8de999ad8a41648c6327c454a08c05', 'request_id': 'req-8a23036d-897c-4ecf-8f09-b155505884fa'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.478585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] The token cache is being invalidate because project ad8de999ad8a41648c6327c454a08c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:03.478953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.481530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.488348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 908/1815] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:03 2022] DELETE /identity/v3/projects/ad8de999ad8a41648c6327c454a08c05 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:03.497588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:03.502410 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:03.531437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0251e0-73f6-47fe-b9d9-c2c8072c8cab admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:03.596618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23036d-897c-4ecf-8f09-b155505884fa admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:03.602686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:03.603835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:03.604270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:03.604543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] PATH_INFO: `/v3/users/df42a5cd648c461885884a5edfec0419` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:03.610105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df42a5cd648c461885884a5edfec0419)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:03.612328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:03.632457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10586d4-e90d-42e0-b9c0-dc4d5bfd50e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:03.633892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10586d4-e90d-42e0-b9c0-dc4d5bfd50e3 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:03.634173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10586d4-e90d-42e0-b9c0-dc4d5bfd50e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:03.634732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10586d4-e90d-42e0-b9c0-dc4d5bfd50e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:03.636429 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c10586d4-e90d-42e0-b9c0-dc4d5bfd50e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:03.716041 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10586d4-e90d-42e0-b9c0-dc4d5bfd50e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:03.717950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10586d4-e90d-42e0-b9c0-dc4d5bfd50e3 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:03.732765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 908/1816] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:24:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:24:03.733940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7a2a-e93b-487e-97ae-e0ad6652ce5b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:03.734260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7a2a-e93b-487e-97ae-e0ad6652ce5b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:03.736993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7a2a-e93b-487e-97ae-e0ad6652ce5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:03.784002 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2eff7a2a-e93b-487e-97ae-e0ad6652ce5b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:03.786394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2eff7a2a-e93b-487e-97ae-e0ad6652ce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:03.808181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 909/1817] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:03.817398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d07f-4aed-4fec-bd26-62ea65a57107 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:03.817756 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d07f-4aed-4fec-bd26-62ea65a57107 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:03.818160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d07f-4aed-4fec-bd26-62ea65a57107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:03.890702 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-83b6d07f-4aed-4fec-bd26-62ea65a57107 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:03.896311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-83b6d07f-4aed-4fec-bd26-62ea65a57107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:03.909605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 910/1818] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:03.911299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5dea6-21ff-4e1a-8a36-85ca01504794 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:03.912265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5dea6-21ff-4e1a-8a36-85ca01504794 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:03.912753 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5dea6-21ff-4e1a-8a36-85ca01504794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:03.966198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df42a5cd648c461885884a5edfec0419'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.966956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df42a5cd648c461885884a5edfec0419'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:03.974998 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5bd5dea6-21ff-4e1a-8a36-85ca01504794 None None] MFA Rules not processed for user `4ad54a22e6e747d9887c82bb62a923da`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:03.977957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5bd5dea6-21ff-4e1a-8a36-85ca01504794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:03.986606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df42a5cd648c461885884a5edfec0419'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:04.010505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df42a5cd648c461885884a5edfec0419'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:04.109793 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 911/1819] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Aug 17 16:24:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:04.110951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5dea6-21ff-4e1a-8a36-85ca01504794 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:04.133402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df42a5cd648c461885884a5edfec0419'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:04.141417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 909/1820] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:03 2022] DELETE /identity/v3/users/df42a5cd648c461885884a5edfec0419 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:04.142324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:04.143690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:04.146564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5dea6-21ff-4e1a-8a36-85ca01504794 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:04.314088 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e68ee5-34c0-4d01-9c78-9cc8c01f019b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:04.314329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf33c65-d39c-446e-85bc-42c239ecbc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:04.314329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33c65-d39c-446e-85bc-42c239ecbc56 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:04.314329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33c65-d39c-446e-85bc-42c239ecbc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:04.314815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33c65-d39c-446e-85bc-42c239ecbc56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:04.315953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435dbd7-2fa1-485d-97b9-aaf03476995e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:04.316586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435dbd7-2fa1-485d-97b9-aaf03476995e service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:04.316852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf33c65-d39c-446e-85bc-42c239ecbc56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:04.316964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435dbd7-2fa1-485d-97b9-aaf03476995e service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:04.317170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435dbd7-2fa1-485d-97b9-aaf03476995e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:04.318591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf33c65-d39c-446e-85bc-42c239ecbc56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:04.320458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf33c65-d39c-446e-85bc-42c239ecbc56 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:04.326576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a435dbd7-2fa1-485d-97b9-aaf03476995e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:04.341237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435dbd7-2fa1-485d-97b9-aaf03476995e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:04.346336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435dbd7-2fa1-485d-97b9-aaf03476995e service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:04.357784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 912/1821] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:04.358920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf33c65-d39c-446e-85bc-42c239ecbc56 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:04.362205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 910/1822] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:04.368858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bcf33c65-d39c-446e-85bc-42c239ecbc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:04.384656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf33c65-d39c-446e-85bc-42c239ecbc56 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:04.390701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5af4f-f6a0-4843-a3cc-2db430564809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:04.391333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5af4f-f6a0-4843-a3cc-2db430564809 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:04.391613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5af4f-f6a0-4843-a3cc-2db430564809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:04.391946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5af4f-f6a0-4843-a3cc-2db430564809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:04.392583 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5af4f-f6a0-4843-a3cc-2db430564809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:04.394702 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5af4f-f6a0-4843-a3cc-2db430564809 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:04.500473 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 913/1823] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:04 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:04.504539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435dbd7-2fa1-485d-97b9-aaf03476995e service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:04.530114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435dbd7-2fa1-485d-97b9-aaf03476995e service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:04.542740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:04.661390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470533d7-1900-4e8b-b748-64721138ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:04.663636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470533d7-1900-4e8b-b748-64721138ab17 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:04.664046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470533d7-1900-4e8b-b748-64721138ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:04.664814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470533d7-1900-4e8b-b748-64721138ab17 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:04.666101 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470533d7-1900-4e8b-b748-64721138ab17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:04.670307 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470533d7-1900-4e8b-b748-64721138ab17 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:04.820033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 911/1824] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:04 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:04.825168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5af4f-f6a0-4843-a3cc-2db430564809 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:04.831213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470533d7-1900-4e8b-b748-64721138ab17 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:04.834887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-470533d7-1900-4e8b-b748-64721138ab17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:04.848829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5af4f-f6a0-4843-a3cc-2db430564809 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:04.851058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470533d7-1900-4e8b-b748-64721138ab17 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:04.860495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e719d-5b6b-4472-bda6-c03165c50e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:04.866173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e719d-5b6b-4472-bda6-c03165c50e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:04.873837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e719d-5b6b-4472-bda6-c03165c50e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:04.873837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e719d-5b6b-4472-bda6-c03165c50e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:04.873837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e719d-5b6b-4472-bda6-c03165c50e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:04.874125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8ee63-2894-4617-bccc-0e86e87a48a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:04.874125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8ee63-2894-4617-bccc-0e86e87a48a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:04.874125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8ee63-2894-4617-bccc-0e86e87a48a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:04.874125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8ee63-2894-4617-bccc-0e86e87a48a1 admin admin] PATH_INFO: `/v3/users/af8b6a4c841442abbbe4f841d8536b86` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:04.874540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e719d-5b6b-4472-bda6-c03165c50e40 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:04.874628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8ee63-2894-4617-bccc-0e86e87a48a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8b6a4c841442abbbe4f841d8536b86)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:04.875491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8ee63-2894-4617-bccc-0e86e87a48a1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:04.920332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 914/1825] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:04.926144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e719d-5b6b-4472-bda6-c03165c50e40 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:04.966102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e719d-5b6b-4472-bda6-c03165c50e40 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:04.991198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78018503-40e4-4229-ac33-44acad6d02b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:04.991943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78018503-40e4-4229-ac33-44acad6d02b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:04.992919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78018503-40e4-4229-ac33-44acad6d02b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:04.993206 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78018503-40e4-4229-ac33-44acad6d02b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:04.993978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78018503-40e4-4229-ac33-44acad6d02b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:05.016087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78018503-40e4-4229-ac33-44acad6d02b3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:05.032656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 915/1826] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:05.039677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78018503-40e4-4229-ac33-44acad6d02b3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:05.079942 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78018503-40e4-4229-ac33-44acad6d02b3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:05.104618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:05.106018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2dfb8-f9a8-4cdb-b472-299d037eca1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:05.113401 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2dfb8-f9a8-4cdb-b472-299d037eca1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:05.113401 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2dfb8-f9a8-4cdb-b472-299d037eca1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:05.113401 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2dfb8-f9a8-4cdb-b472-299d037eca1f admin admin] PATH_INFO: `/v3/projects/2c76b8f6b547444bbf9d60e7185c25a8/users/69704454bbd44562834e42b4d1a901c8/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:05.149192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2dfb8-f9a8-4cdb-b472-299d037eca1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c76b8f6b547444bbf9d60e7185c25a8, user_id=69704454bbd44562834e42b4d1a901c8, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:05.154974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2dfb8-f9a8-4cdb-b472-299d037eca1f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:05.269829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-54b8ee63-2894-4617-bccc-0e86e87a48a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8b6a4c841442abbbe4f841d8536b86'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:05.271117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-54b8ee63-2894-4617-bccc-0e86e87a48a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8b6a4c841442abbbe4f841d8536b86'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:05.286292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-54b8ee63-2894-4617-bccc-0e86e87a48a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8b6a4c841442abbbe4f841d8536b86'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:05.286488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 916/1827] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:05 2022] PUT /identity/v3/projects/2c76b8f6b547444bbf9d60e7185c25a8/users/69704454bbd44562834e42b4d1a901c8/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:05.301757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11adc1b-38bf-43f4-9d8c-1c0e3c233583 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:05.304545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11adc1b-38bf-43f4-9d8c-1c0e3c233583 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:05.305903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11adc1b-38bf-43f4-9d8c-1c0e3c233583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:05.309526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-54b8ee63-2894-4617-bccc-0e86e87a48a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8b6a4c841442abbbe4f841d8536b86'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:05.416505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a11adc1b-38bf-43f4-9d8c-1c0e3c233583 None None] MFA Rules not processed for user `69704454bbd44562834e42b4d1a901c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:05.419639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a11adc1b-38bf-43f4-9d8c-1c0e3c233583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:05.434248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-54b8ee63-2894-4617-bccc-0e86e87a48a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8b6a4c841442abbbe4f841d8536b86'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:05.444842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 912/1828] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:04 2022] DELETE /identity/v3/users/af8b6a4c841442abbbe4f841d8536b86 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:05.448657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e75a1d-43a0-4bba-b26a-a8171f4c7517 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:05.449013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e75a1d-43a0-4bba-b26a-a8171f4c7517 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:05.449327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e75a1d-43a0-4bba-b26a-a8171f4c7517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:05.527494 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-91e75a1d-43a0-4bba-b26a-a8171f4c7517 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:05.530580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-91e75a1d-43a0-4bba-b26a-a8171f4c7517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:05.590097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 917/1829] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:05.594737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11adc1b-38bf-43f4-9d8c-1c0e3c233583 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:05.596835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a11adc1b-38bf-43f4-9d8c-1c0e3c233583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:05.689495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 913/1830] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:05.694857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e75a1d-43a0-4bba-b26a-a8171f4c7517 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:05.696920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-91e75a1d-43a0-4bba-b26a-a8171f4c7517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:05.714160 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e75a1d-43a0-4bba-b26a-a8171f4c7517 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:05.722959 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:05.724721 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:05.725874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:05.727184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] PATH_INFO: `/v3/projects/0e7a5f33fecb497485e1d3baafa8115d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:05.729005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7a5f33fecb497485e1d3baafa8115d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:05.731484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:05.780763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11adc1b-38bf-43f4-9d8c-1c0e3c233583 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:05.794839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f5ec8-62ae-4c52-afb3-f1aa782464ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:05.794839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f5ec8-62ae-4c52-afb3-f1aa782464ac admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:05.795117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f5ec8-62ae-4c52-afb3-f1aa782464ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:05.795357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f5ec8-62ae-4c52-afb3-f1aa782464ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:05.805583 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f5ec8-62ae-4c52-afb3-f1aa782464ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:05.808454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f5ec8-62ae-4c52-afb3-f1aa782464ac admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:05.917283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:05.944727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 918/1831] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:05 2022] POST /identity/v3/projects => generated 385 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:05.945695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f5ec8-62ae-4c52-afb3-f1aa782464ac admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:05.948277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a47f5ec8-62ae-4c52-afb3-f1aa782464ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:05.959546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7a5f33fecb497485e1d3baafa8115d', 'request_id': 'req-a69458f2-ea26-47f7-a68b-225c4417e5a4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:05.995986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7a5f33fecb497485e1d3baafa8115d', 'request_id': 'req-a69458f2-ea26-47f7-a68b-225c4417e5a4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:06.086470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7a5f33fecb497485e1d3baafa8115d', 'request_id': 'req-a69458f2-ea26-47f7-a68b-225c4417e5a4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:06.106271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] The token cache is being invalidate because project 0e7a5f33fecb497485e1d3baafa8115d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:06.106648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:06.109206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:06.113976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 914/1832] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:05 2022] DELETE /identity/v3/projects/0e7a5f33fecb497485e1d3baafa8115d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:06.115520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:06.122293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:06.166696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f5ec8-62ae-4c52-afb3-f1aa782464ac admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:06.171158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41681b83-c91b-430b-9650-3ed1caeba304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:06.178234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41681b83-c91b-430b-9650-3ed1caeba304 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:06.178234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41681b83-c91b-430b-9650-3ed1caeba304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:06.178234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41681b83-c91b-430b-9650-3ed1caeba304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:06.178234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-41681b83-c91b-430b-9650-3ed1caeba304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:06.300139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69458f2-ea26-47f7-a68b-225c4417e5a4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:06.369621 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:06.389306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41681b83-c91b-430b-9650-3ed1caeba304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:06.391571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41681b83-c91b-430b-9650-3ed1caeba304 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:06.410443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 919/1833] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:06.413534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915546a3-642c-4aec-b551-71460d936e2f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:06.413827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915546a3-642c-4aec-b551-71460d936e2f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:06.414729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915546a3-642c-4aec-b551-71460d936e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:06.447432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-915546a3-642c-4aec-b551-71460d936e2f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:06.451288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-915546a3-642c-4aec-b551-71460d936e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:06.468309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d06ce5-9a2c-47a4-9949-fc458ed091b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:06.469279 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06ce5-9a2c-47a4-9949-fc458ed091b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:06.469791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06ce5-9a2c-47a4-9949-fc458ed091b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:06.470230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06ce5-9a2c-47a4-9949-fc458ed091b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:06.471017 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d06ce5-9a2c-47a4-9949-fc458ed091b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:06.473268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d06ce5-9a2c-47a4-9949-fc458ed091b2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:06.483944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 920/1834] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:06.491826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b5cce-b650-45c4-9606-bb38190ec89f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:06.492239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b5cce-b650-45c4-9606-bb38190ec89f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:06.492796 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b5cce-b650-45c4-9606-bb38190ec89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:06.517234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f05b5cce-b650-45c4-9606-bb38190ec89f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:06.519531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f05b5cce-b650-45c4-9606-bb38190ec89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:06.532809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 921/1835] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:06.537604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b5cce-b650-45c4-9606-bb38190ec89f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:06.550492 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b5cce-b650-45c4-9606-bb38190ec89f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:06.584811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 915/1836] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:06 2022] POST /identity/v3/users => generated 293 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:06.589545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d06ce5-9a2c-47a4-9949-fc458ed091b2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:06.609094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d06ce5-9a2c-47a4-9949-fc458ed091b2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:06.617834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a5d19-b794-455a-98d9-8a7d33e19310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:06.619784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5d19-b794-455a-98d9-8a7d33e19310 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:06.624764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c62e5-6220-466d-8551-a023480b7eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:06.625190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5d19-b794-455a-98d9-8a7d33e19310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:06.629071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c62e5-6220-466d-8551-a023480b7eca admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:06.629071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c62e5-6220-466d-8551-a023480b7eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:06.629071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c62e5-6220-466d-8551-a023480b7eca admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:06.629071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c62e5-6220-466d-8551-a023480b7eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:06.629782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5d19-b794-455a-98d9-8a7d33e19310 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:06.631455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c62e5-6220-466d-8551-a023480b7eca admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:06.632456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a5d19-b794-455a-98d9-8a7d33e19310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:06.633346 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a5d19-b794-455a-98d9-8a7d33e19310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:06.645923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a5d19-b794-455a-98d9-8a7d33e19310 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:06.675785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 916/1837] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:06.680233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c62e5-6220-466d-8551-a023480b7eca admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:06.694549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 922/1838] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:06.700211 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a5d19-b794-455a-98d9-8a7d33e19310 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:06.702461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c62e5-6220-466d-8551-a023480b7eca admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:06.706321 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:06.718955 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cadd4-0dcc-4881-aa15-a3fffca884a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:06.720013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cadd4-0dcc-4881-aa15-a3fffca884a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:06.720555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cadd4-0dcc-4881-aa15-a3fffca884a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:06.721098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cadd4-0dcc-4881-aa15-a3fffca884a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:06.722064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cadd4-0dcc-4881-aa15-a3fffca884a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:06.724397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cadd4-0dcc-4881-aa15-a3fffca884a2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:06.753387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a5d19-b794-455a-98d9-8a7d33e19310 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:06.758715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 917/1839] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:06.764131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cadd4-0dcc-4881-aa15-a3fffca884a2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:06.770411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93072f-3e1a-4bf8-9547-41a70a71e54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:06.771179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93072f-3e1a-4bf8-9547-41a70a71e54c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:06.771555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93072f-3e1a-4bf8-9547-41a70a71e54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:06.771978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93072f-3e1a-4bf8-9547-41a70a71e54c admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:06.772814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93072f-3e1a-4bf8-9547-41a70a71e54c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:06.776220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93072f-3e1a-4bf8-9547-41a70a71e54c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:06.802943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cadd4-0dcc-4881-aa15-a3fffca884a2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:06.811306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c58f3-49a8-4de2-84c5-ef238ed059ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:06.812437 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c58f3-49a8-4de2-84c5-ef238ed059ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:06.812917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c58f3-49a8-4de2-84c5-ef238ed059ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:06.813435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c58f3-49a8-4de2-84c5-ef238ed059ef admin admin] PATH_INFO: `/v3/projects/f5efae72c84b472794e0ef1ef5f5ee70/users/4216281daacc436fa8a7fa146992347e/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:06.834652 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c58f3-49a8-4de2-84c5-ef238ed059ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5efae72c84b472794e0ef1ef5f5ee70, user_id=4216281daacc436fa8a7fa146992347e, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:06.840586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c58f3-49a8-4de2-84c5-ef238ed059ef admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:06.910622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 923/1840] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:06 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:06.915519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93072f-3e1a-4bf8-9547-41a70a71e54c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:06.934812 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 918/1841] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:06 2022] PUT /identity/v3/projects/f5efae72c84b472794e0ef1ef5f5ee70/users/4216281daacc436fa8a7fa146992347e/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:06.937255 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09a79-cdbd-4410-8926-d3c3690d00bd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:06.937583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09a79-cdbd-4410-8926-d3c3690d00bd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:06.938105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09a79-cdbd-4410-8926-d3c3690d00bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:06.974014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-efa09a79-cdbd-4410-8926-d3c3690d00bd None None] MFA Rules not processed for user `4216281daacc436fa8a7fa146992347e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:06.976055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-efa09a79-cdbd-4410-8926-d3c3690d00bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:07.095098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93072f-3e1a-4bf8-9547-41a70a71e54c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:07.153853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 919/1842] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:07.155881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa09a79-cdbd-4410-8926-d3c3690d00bd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:07.243315 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02032c-c243-4c9d-bff1-5e5bb7baf4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:07.244399 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02032c-c243-4c9d-bff1-5e5bb7baf4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:07.245161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02032c-c243-4c9d-bff1-5e5bb7baf4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:07.245640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02032c-c243-4c9d-bff1-5e5bb7baf4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:07.247545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02032c-c243-4c9d-bff1-5e5bb7baf4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:07.250979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02032c-c243-4c9d-bff1-5e5bb7baf4d5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:07.326929 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa09a79-cdbd-4410-8926-d3c3690d00bd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:07.333619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c0e71-8982-4186-9940-abcc54a39751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:07.334283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c0e71-8982-4186-9940-abcc54a39751 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:07.334565 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c0e71-8982-4186-9940-abcc54a39751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:07.334833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c0e71-8982-4186-9940-abcc54a39751 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:07.335612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c0e71-8982-4186-9940-abcc54a39751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:07.339977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c0e71-8982-4186-9940-abcc54a39751 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:07.442874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 924/1843] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:06 2022] POST /identity/v3/users => generated 287 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:07.444459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947832de-b505-412a-8488-9beb774813db None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:07.447985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947832de-b505-412a-8488-9beb774813db None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:07.448374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947832de-b505-412a-8488-9beb774813db None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:07.451608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 925/1844] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 17 16:24:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:24:07.456478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947832de-b505-412a-8488-9beb774813db None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:07.520663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947832de-b505-412a-8488-9beb774813db None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:07.550484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d40b2-26fd-492d-af35-5be27b838886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:07.557356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 920/1845] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:07 2022] POST /identity/v3/projects => generated 385 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:07.560895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d40b2-26fd-492d-af35-5be27b838886 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:07.561093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb6f6-a780-4ff8-a038-5f427baa7953 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:07.561576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb6f6-a780-4ff8-a038-5f427baa7953 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:07.562003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeb6f6-a780-4ff8-a038-5f427baa7953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:07.562418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d40b2-26fd-492d-af35-5be27b838886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:07.564971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d40b2-26fd-492d-af35-5be27b838886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:07.566010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d40b2-26fd-492d-af35-5be27b838886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:07.571006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d40b2-26fd-492d-af35-5be27b838886 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:07.621102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 926/1846] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:07.622650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d40b2-26fd-492d-af35-5be27b838886 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:07.636576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c4eeb6f6-a780-4ff8-a038-5f427baa7953 None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:07.637203 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d40b2-26fd-492d-af35-5be27b838886 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:07.639032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c4eeb6f6-a780-4ff8-a038-5f427baa7953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:07.673735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:07.783045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:07.825917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 921/1847] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 17 16:24:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:07.827977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeb6f6-a780-4ff8-a038-5f427baa7953 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:07.855947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeb6f6-a780-4ff8-a038-5f427baa7953 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:07.864592 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d91f5e-ec53-46f8-bbdf-7f2171783167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:07.866112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91f5e-ec53-46f8-bbdf-7f2171783167 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:07.868198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91f5e-ec53-46f8-bbdf-7f2171783167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:07.868401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509db2f3-0215-4ed5-ad43-3a09475651a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:07.868932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91f5e-ec53-46f8-bbdf-7f2171783167 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:07.869047 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509db2f3-0215-4ed5-ad43-3a09475651a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:07.869288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509db2f3-0215-4ed5-ad43-3a09475651a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:07.869610 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509db2f3-0215-4ed5-ad43-3a09475651a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:07.872144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509db2f3-0215-4ed5-ad43-3a09475651a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:07.872370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d91f5e-ec53-46f8-bbdf-7f2171783167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:07.874123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d91f5e-ec53-46f8-bbdf-7f2171783167 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:07.879942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509db2f3-0215-4ed5-ad43-3a09475651a7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:07.927657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 922/1848] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:07.927657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509db2f3-0215-4ed5-ad43-3a09475651a7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:07.927657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-509db2f3-0215-4ed5-ad43-3a09475651a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:07.962824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509db2f3-0215-4ed5-ad43-3a09475651a7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:07.973943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 927/1849] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:07 2022] POST /identity/v3/users => generated 299 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:07.975701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76105e01-c8c8-48da-ad2d-71b502ad2620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:07.975941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d91f5e-ec53-46f8-bbdf-7f2171783167 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:07.976859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76105e01-c8c8-48da-ad2d-71b502ad2620 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:07.977138 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76105e01-c8c8-48da-ad2d-71b502ad2620 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:07.977830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76105e01-c8c8-48da-ad2d-71b502ad2620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:07.999664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76105e01-c8c8-48da-ad2d-71b502ad2620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:08.001356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76105e01-c8c8-48da-ad2d-71b502ad2620 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:08.010292 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d91f5e-ec53-46f8-bbdf-7f2171783167 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:08.027722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 923/1850] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:08.029701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76105e01-c8c8-48da-ad2d-71b502ad2620 service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:08.033917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-76105e01-c8c8-48da-ad2d-71b502ad2620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:08.048068 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d1f13-2b54-4947-a897-b6e4449b13bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:08.053196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d1f13-2b54-4947-a897-b6e4449b13bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:08.053855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d1f13-2b54-4947-a897-b6e4449b13bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:08.055191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d1f13-2b54-4947-a897-b6e4449b13bc admin admin] PATH_INFO: `/v3/projects/f7c9a5af35134001a6a9a1933ee883cd/users/6d4c17658647480ab4e9a77b3c6f9462/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:08.073883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76105e01-c8c8-48da-ad2d-71b502ad2620 service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:08.082095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:08.082095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:08.082095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:08.082095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] PATH_INFO: `/v3/projects/494c7b56f55f4011a7048f43ec0b8189` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:08.083838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=494c7b56f55f4011a7048f43ec0b8189)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:08.086132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:08.104896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d1f13-2b54-4947-a897-b6e4449b13bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c9a5af35134001a6a9a1933ee883cd, user_id=6d4c17658647480ab4e9a77b3c6f9462, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:08.109988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d1f13-2b54-4947-a897-b6e4449b13bc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:08.218699 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 928/1851] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:07 2022] PUT /identity/v3/projects/f7c9a5af35134001a6a9a1933ee883cd/users/6d4c17658647480ab4e9a77b3c6f9462/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:08.219539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d1f13-2b54-4947-a897-b6e4449b13bc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:08.260334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494c7b56f55f4011a7048f43ec0b8189', 'request_id': 'req-f5198822-3f2c-4e61-80e6-3d0fc637e46b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:08.276918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494c7b56f55f4011a7048f43ec0b8189', 'request_id': 'req-f5198822-3f2c-4e61-80e6-3d0fc637e46b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:08.357603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d1f13-2b54-4947-a897-b6e4449b13bc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:08.377566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494c7b56f55f4011a7048f43ec0b8189', 'request_id': 'req-f5198822-3f2c-4e61-80e6-3d0fc637e46b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:08.395801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] The token cache is being invalidate because project 494c7b56f55f4011a7048f43ec0b8189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:08.396137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:08.399685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f5198822-3f2c-4e61-80e6-3d0fc637e46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:08.403258 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 924/1852] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:08 2022] DELETE /identity/v3/projects/494c7b56f55f4011a7048f43ec0b8189 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:08.407536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d16b8-55ea-4884-8604-27ed43c0fd75 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:08.407823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d16b8-55ea-4884-8604-27ed43c0fd75 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:08.408101 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d16b8-55ea-4884-8604-27ed43c0fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:08.476627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c27d16b8-55ea-4884-8604-27ed43c0fd75 None None] MFA Rules not processed for user `6d4c17658647480ab4e9a77b3c6f9462`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:08.480077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c27d16b8-55ea-4884-8604-27ed43c0fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:08.503692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ebb01-ae9b-4591-bc5a-9759113a56d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:08.504375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ebb01-ae9b-4591-bc5a-9759113a56d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:08.520141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ebb01-ae9b-4591-bc5a-9759113a56d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:08.520481 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ebb01-ae9b-4591-bc5a-9759113a56d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:08.522201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ebb01-ae9b-4591-bc5a-9759113a56d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:08.525629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ebb01-ae9b-4591-bc5a-9759113a56d1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:08.559299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 929/1853] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:08.559299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ebb01-ae9b-4591-bc5a-9759113a56d1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:08.562417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e38ebb01-ae9b-4591-bc5a-9759113a56d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:08.587731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ebb01-ae9b-4591-bc5a-9759113a56d1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:08.594012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:08.594894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:08.595321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:08.595824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] PATH_INFO: `/v3/users/2f7b88f3b8dd4005a5ef257ef14d3689` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:08.601970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7b88f3b8dd4005a5ef257ef14d3689)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:08.605805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:08.612119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:08.681472 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 925/1854] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:08.688491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d16b8-55ea-4884-8604-27ed43c0fd75 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:08.691350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c27d16b8-55ea-4884-8604-27ed43c0fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:08.718792 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d16b8-55ea-4884-8604-27ed43c0fd75 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:08.754069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:08.761649 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356ac40-bb42-4590-914d-16e95fce1159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:08.762954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ac40-bb42-4590-914d-16e95fce1159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:08.763492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ac40-bb42-4590-914d-16e95fce1159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:08.765295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ac40-bb42-4590-914d-16e95fce1159 admin admin] PATH_INFO: `/v3/projects/2e928bea0f624e65ac42b88824cd6dea/users/14a85260915f440f8fdc3e89b67a9e78/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:08.804631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356ac40-bb42-4590-914d-16e95fce1159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e928bea0f624e65ac42b88824cd6dea, user_id=14a85260915f440f8fdc3e89b67a9e78, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:08.808253 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356ac40-bb42-4590-914d-16e95fce1159 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:08.837091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7b88f3b8dd4005a5ef257ef14d3689'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:08.837841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7b88f3b8dd4005a5ef257ef14d3689'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:08.870977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7b88f3b8dd4005a5ef257ef14d3689'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:08.890218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7b88f3b8dd4005a5ef257ef14d3689'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:08.891583 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7b88f3b8dd4005a5ef257ef14d3689'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:08.898782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 926/1855] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:08 2022] PUT /identity/v3/projects/2e928bea0f624e65ac42b88824cd6dea/users/14a85260915f440f8fdc3e89b67a9e78/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:08.902058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356ac40-bb42-4590-914d-16e95fce1159 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:08.904296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b356ac40-bb42-4590-914d-16e95fce1159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:08.944149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:08.972763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 930/1856] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:08 2022] DELETE /identity/v3/users/2f7b88f3b8dd4005a5ef257ef14d3689 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:08.976837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:08.976837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:09.056158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356ac40-bb42-4590-914d-16e95fce1159 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:09.147277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034ff79-8657-4558-bfd2-85fcd8070530 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:09.153637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c1e88-a3a7-4c3e-8021-73589006d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:09.155960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c1e88-a3a7-4c3e-8021-73589006d20d admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:09.155960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c1e88-a3a7-4c3e-8021-73589006d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:09.155960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c1e88-a3a7-4c3e-8021-73589006d20d admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:09.156223 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c1e88-a3a7-4c3e-8021-73589006d20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:09.157735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c1e88-a3a7-4c3e-8021-73589006d20d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:09.172431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 931/1857] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:09.177855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c1e88-a3a7-4c3e-8021-73589006d20d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:09.208866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:09.225050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c1e88-a3a7-4c3e-8021-73589006d20d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:09.250795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b500c5-244f-4772-b514-421c3814239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:09.255244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b500c5-244f-4772-b514-421c3814239d admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:09.255926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b500c5-244f-4772-b514-421c3814239d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:09.257211 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b500c5-244f-4772-b514-421c3814239d admin admin] PATH_INFO: `/v3/projects/2e928bea0f624e65ac42b88824cd6dea/users/14a85260915f440f8fdc3e89b67a9e78/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:09.263494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b500c5-244f-4772-b514-421c3814239d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e928bea0f624e65ac42b88824cd6dea, user_id=14a85260915f440f8fdc3e89b67a9e78, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:09.277787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580333d-8f83-43ee-a01d-7d0ee6265178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:09.278940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b500c5-244f-4772-b514-421c3814239d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:09.280073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580333d-8f83-43ee-a01d-7d0ee6265178 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:09.281105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580333d-8f83-43ee-a01d-7d0ee6265178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:09.281511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580333d-8f83-43ee-a01d-7d0ee6265178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:09.282948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580333d-8f83-43ee-a01d-7d0ee6265178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:09.286761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580333d-8f83-43ee-a01d-7d0ee6265178 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:09.313414 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 932/1858] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:09 2022] PUT /identity/v3/projects/2e928bea0f624e65ac42b88824cd6dea/users/14a85260915f440f8fdc3e89b67a9e78/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:09.326117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40eabb-b271-4102-a06f-4229136dd493 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:09.327283 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40eabb-b271-4102-a06f-4229136dd493 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:09.329031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40eabb-b271-4102-a06f-4229136dd493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:09.441740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6a40eabb-b271-4102-a06f-4229136dd493 None None] MFA Rules not processed for user `14a85260915f440f8fdc3e89b67a9e78`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:09.444701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6a40eabb-b271-4102-a06f-4229136dd493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:09.473161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 927/1859] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:08 2022] POST /identity/v3/projects => generated 371 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:09.484459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580333d-8f83-43ee-a01d-7d0ee6265178 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:09.642555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 933/1860] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:09.642555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8959af-a727-4334-a425-a20820baa8db None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:09.642555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8959af-a727-4334-a425-a20820baa8db None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:09.642555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8959af-a727-4334-a425-a20820baa8db None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:09.645727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 934/1861] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 17 16:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:24:09.660803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8959af-a727-4334-a425-a20820baa8db None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:09.663521 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3c8959af-a727-4334-a425-a20820baa8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:09.766925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580333d-8f83-43ee-a01d-7d0ee6265178 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:09.782968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deded46-015b-4f1e-932b-ad4e9637c3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:09.782968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deded46-015b-4f1e-932b-ad4e9637c3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:09.782968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deded46-015b-4f1e-932b-ad4e9637c3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:09.782968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deded46-015b-4f1e-932b-ad4e9637c3d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:09.783413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deded46-015b-4f1e-932b-ad4e9637c3d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:09.785157 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deded46-015b-4f1e-932b-ad4e9637c3d9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:09.896283 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8959af-a727-4334-a425-a20820baa8db None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:09.910153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaaf21-ddda-4ddc-848f-3d7e56552970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:09.920803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaaf21-ddda-4ddc-848f-3d7e56552970 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:09.920803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaaf21-ddda-4ddc-848f-3d7e56552970 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:09.920803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaaf21-ddda-4ddc-848f-3d7e56552970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:09.930440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 928/1862] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:09 2022] POST /identity/v3/users => generated 292 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:09.933090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819cfeb-685d-46ae-b1dd-f8b1d04e37bf None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:09.934675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819cfeb-685d-46ae-b1dd-f8b1d04e37bf None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:09.935285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819cfeb-685d-46ae-b1dd-f8b1d04e37bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:09.993946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5819cfeb-685d-46ae-b1dd-f8b1d04e37bf None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:09.995219 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5819cfeb-685d-46ae-b1dd-f8b1d04e37bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:10.134638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaaf21-ddda-4ddc-848f-3d7e56552970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:10.136449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaaf21-ddda-4ddc-848f-3d7e56552970 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:10.165594 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 935/1863] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:10.167236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaaf21-ddda-4ddc-848f-3d7e56552970 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:10.195235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaaf21-ddda-4ddc-848f-3d7e56552970 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:10.214166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1576c1-376c-4e71-8298-f50e6d85696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:10.215926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1576c1-376c-4e71-8298-f50e6d85696b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:10.218377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1576c1-376c-4e71-8298-f50e6d85696b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:10.218923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1576c1-376c-4e71-8298-f50e6d85696b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:10.224624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1576c1-376c-4e71-8298-f50e6d85696b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:10.230497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1576c1-376c-4e71-8298-f50e6d85696b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:10.245581 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 929/1864] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 17 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:10.264911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 936/1865] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:10.267582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819cfeb-685d-46ae-b1dd-f8b1d04e37bf None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:10.275884 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:10.296446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819cfeb-685d-46ae-b1dd-f8b1d04e37bf None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:10.315720 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59c351-1385-4158-86f6-67ec35da4047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:10.316623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c351-1385-4158-86f6-67ec35da4047 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:10.317877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c351-1385-4158-86f6-67ec35da4047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:10.319336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59c351-1385-4158-86f6-67ec35da4047 admin admin] PATH_INFO: `/v3/projects/821a9fcdf4874229880e56e72f4007e6/users/592cd69cfb0b4096b21f1ccebbdd476c/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:10.343864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59c351-1385-4158-86f6-67ec35da4047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=821a9fcdf4874229880e56e72f4007e6, user_id=592cd69cfb0b4096b21f1ccebbdd476c, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:10.348450 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59c351-1385-4158-86f6-67ec35da4047 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:10.458359 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 930/1866] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:10 2022] PUT /identity/v3/projects/821a9fcdf4874229880e56e72f4007e6/users/592cd69cfb0b4096b21f1ccebbdd476c/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:10.461400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1576c1-376c-4e71-8298-f50e6d85696b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:10.475733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1576c1-376c-4e71-8298-f50e6d85696b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:10.649893 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aa40f-f24d-400d-8f63-fc0eae254550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:10.651164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aa40f-f24d-400d-8f63-fc0eae254550 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:10.651904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aa40f-f24d-400d-8f63-fc0eae254550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:10.659239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aa40f-f24d-400d-8f63-fc0eae254550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:10.660093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aa40f-f24d-400d-8f63-fc0eae254550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:10.663102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aa40f-f24d-400d-8f63-fc0eae254550 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:10.711403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59c351-1385-4158-86f6-67ec35da4047 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:10.718013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 937/1867] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:10.739613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59c351-1385-4158-86f6-67ec35da4047 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:10.749095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f443-83f9-442e-a393-f93b985aafff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:10.749924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f443-83f9-442e-a393-f93b985aafff admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:10.750307 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f443-83f9-442e-a393-f93b985aafff admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:10.750756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f443-83f9-442e-a393-f93b985aafff admin admin] PATH_INFO: `/v3/projects/821a9fcdf4874229880e56e72f4007e6/users/592cd69cfb0b4096b21f1ccebbdd476c/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:10.753711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526f443-83f9-442e-a393-f93b985aafff admin admin] RBAC: Authorizing `identity:create_grant(project_id=821a9fcdf4874229880e56e72f4007e6, user_id=592cd69cfb0b4096b21f1ccebbdd476c, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:10.756986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526f443-83f9-442e-a393-f93b985aafff admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:10.802702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 931/1868] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:10 2022] PUT /identity/v3/projects/821a9fcdf4874229880e56e72f4007e6/users/592cd69cfb0b4096b21f1ccebbdd476c/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:10.821893 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c263ef0-cdb9-425c-8cab-ef6433399f03 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:10.822189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c263ef0-cdb9-425c-8cab-ef6433399f03 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:10.825883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c263ef0-cdb9-425c-8cab-ef6433399f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:10.869090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f443-83f9-442e-a393-f93b985aafff admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:10.872184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a526f443-83f9-442e-a393-f93b985aafff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:10.934500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2c263ef0-cdb9-425c-8cab-ef6433399f03 None None] MFA Rules not processed for user `592cd69cfb0b4096b21f1ccebbdd476c`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:10.935992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2c263ef0-cdb9-425c-8cab-ef6433399f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:11.216275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 938/1869] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:11.220198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f443-83f9-442e-a393-f93b985aafff admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:11.221126 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c263ef0-cdb9-425c-8cab-ef6433399f03 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:11.223448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2c263ef0-cdb9-425c-8cab-ef6433399f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:11.247634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2b19f-3184-4f95-b7ca-90797b655646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:11.248264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2b19f-3184-4f95-b7ca-90797b655646 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:11.248620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2b19f-3184-4f95-b7ca-90797b655646 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:11.248914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2b19f-3184-4f95-b7ca-90797b655646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:11.302721 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2b19f-3184-4f95-b7ca-90797b655646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:11.305107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2b19f-3184-4f95-b7ca-90797b655646 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:11.317896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 932/1870] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:11.359951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:11.368196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c263ef0-cdb9-425c-8cab-ef6433399f03 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:11.373381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:11.374777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:11.374777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:11.374777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] PATH_INFO: `/v3/projects/012ba3fcf9bc41508753e6253bbd4ccb` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:11.375835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=012ba3fcf9bc41508753e6253bbd4ccb)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:11.378203 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:11.431774 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2b19f-3184-4f95-b7ca-90797b655646 service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:11.531368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012ba3fcf9bc41508753e6253bbd4ccb', 'request_id': 'req-ee1be286-035a-4ffa-a023-d1c38262d21a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:11.562350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012ba3fcf9bc41508753e6253bbd4ccb', 'request_id': 'req-ee1be286-035a-4ffa-a023-d1c38262d21a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:11.574919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2b19f-3184-4f95-b7ca-90797b655646 service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:11.578251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012ba3fcf9bc41508753e6253bbd4ccb', 'request_id': 'req-ee1be286-035a-4ffa-a023-d1c38262d21a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:11.682597 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] The token cache is being invalidate because project 012ba3fcf9bc41508753e6253bbd4ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:11.682777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:11.683484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee1be286-035a-4ffa-a023-d1c38262d21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:11.688699 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ca638-a6db-4639-b191-bf0f5a360f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:11.690017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 939/1871] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:11 2022] DELETE /identity/v3/projects/012ba3fcf9bc41508753e6253bbd4ccb => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:11.691549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f743-1142-4176-b723-4a19ebbf0f2c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:11.691841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f743-1142-4176-b723-4a19ebbf0f2c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:11.692291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ca638-a6db-4639-b191-bf0f5a360f1d service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:11.692517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f743-1142-4176-b723-4a19ebbf0f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:11.694261 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ca638-a6db-4639-b191-bf0f5a360f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:11.695707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ca638-a6db-4639-b191-bf0f5a360f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:11.703733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-938ca638-a6db-4639-b191-bf0f5a360f1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:11.739063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-00f7f743-1142-4176-b723-4a19ebbf0f2c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:11.740724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-00f7f743-1142-4176-b723-4a19ebbf0f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:11.856576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ca638-a6db-4639-b191-bf0f5a360f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:11.858145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ca638-a6db-4639-b191-bf0f5a360f1d service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:11.872967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 933/1872] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:11.911492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ca638-a6db-4639-b191-bf0f5a360f1d service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:11.911492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-938ca638-a6db-4639-b191-bf0f5a360f1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:11.912665 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 940/1873] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:11.920209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275517-fd9b-46e5-922f-0b47eefc7246 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:11.920878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275517-fd9b-46e5-922f-0b47eefc7246 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:11.921434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275517-fd9b-46e5-922f-0b47eefc7246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:11.928604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ca638-a6db-4639-b191-bf0f5a360f1d service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:11.939860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b79b5-2f2d-4a2e-aef0-ae0233023262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:11.939860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b79b5-2f2d-4a2e-aef0-ae0233023262 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:11.939860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b79b5-2f2d-4a2e-aef0-ae0233023262 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:11.939860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b79b5-2f2d-4a2e-aef0-ae0233023262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:11.940295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5b9b79b5-2f2d-4a2e-aef0-ae0233023262 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:11.959288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-47275517-fd9b-46e5-922f-0b47eefc7246 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:11.961509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-47275517-fd9b-46e5-922f-0b47eefc7246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:11.979312 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 941/1874] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:11.983207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47275517-fd9b-46e5-922f-0b47eefc7246 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:11.996586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47275517-fd9b-46e5-922f-0b47eefc7246 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:12.009871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1963373-2e98-4753-a682-d1795777f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:12.011864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1963373-2e98-4753-a682-d1795777f067 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:12.012153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1963373-2e98-4753-a682-d1795777f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:12.014106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1963373-2e98-4753-a682-d1795777f067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:12.015477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1963373-2e98-4753-a682-d1795777f067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:12.015785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1963373-2e98-4753-a682-d1795777f067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:12.017567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1963373-2e98-4753-a682-d1795777f067 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:12.033394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b79b5-2f2d-4a2e-aef0-ae0233023262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:12.037428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b79b5-2f2d-4a2e-aef0-ae0233023262 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:12.061788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 942/1875] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:12.066012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1963373-2e98-4753-a682-d1795777f067 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:12.072983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 934/1876] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:12.088111 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1963373-2e98-4753-a682-d1795777f067 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:12.093412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e11cff-7ed0-4cc2-b61c-0b22afeb3cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:12.094215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e11cff-7ed0-4cc2-b61c-0b22afeb3cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:12.094499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e11cff-7ed0-4cc2-b61c-0b22afeb3cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:12.094808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e11cff-7ed0-4cc2-b61c-0b22afeb3cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:12.095411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e11cff-7ed0-4cc2-b61c-0b22afeb3cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:12.097343 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e11cff-7ed0-4cc2-b61c-0b22afeb3cb3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:12.148263 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b79b5-2f2d-4a2e-aef0-ae0233023262 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:12.152893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5b9b79b5-2f2d-4a2e-aef0-ae0233023262 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:12.177043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b79b5-2f2d-4a2e-aef0-ae0233023262 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:12.185266 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54344f-42b8-443b-ae25-8c347ec9950d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:12.190142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54344f-42b8-443b-ae25-8c347ec9950d service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:12.190142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54344f-42b8-443b-ae25-8c347ec9950d service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:12.190142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54344f-42b8-443b-ae25-8c347ec9950d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:12.190142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8b54344f-42b8-443b-ae25-8c347ec9950d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:12.259140 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 943/1877] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:12 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:12.262047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e11cff-7ed0-4cc2-b61c-0b22afeb3cb3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:12.356289 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54344f-42b8-443b-ae25-8c347ec9950d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:12.371557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e11cff-7ed0-4cc2-b61c-0b22afeb3cb3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:12.374564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54344f-42b8-443b-ae25-8c347ec9950d service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:12.377948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef105b6c-e59c-4792-8cab-7060f5264403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:12.378681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105b6c-e59c-4792-8cab-7060f5264403 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:12.379298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105b6c-e59c-4792-8cab-7060f5264403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:12.379682 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105b6c-e59c-4792-8cab-7060f5264403 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:12.380564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef105b6c-e59c-4792-8cab-7060f5264403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:12.391884 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef105b6c-e59c-4792-8cab-7060f5264403 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:12.414821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 935/1878] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:12.496076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 944/1879] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:12 2022] POST /identity/v3/users => generated 284 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:12.501103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54344f-42b8-443b-ae25-8c347ec9950d service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:12.526142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54344f-42b8-443b-ae25-8c347ec9950d service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:12.557162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60feab-7ff4-450f-95d3-d9db24b181d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:12.560890 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60feab-7ff4-450f-95d3-d9db24b181d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:12.561692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60feab-7ff4-450f-95d3-d9db24b181d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:12.562657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60feab-7ff4-450f-95d3-d9db24b181d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:12.564816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60feab-7ff4-450f-95d3-d9db24b181d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:12.568851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60feab-7ff4-450f-95d3-d9db24b181d2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:12.607582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef105b6c-e59c-4792-8cab-7060f5264403 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:12.608158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 936/1880] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:12.623927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef105b6c-e59c-4792-8cab-7060f5264403 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:12.635702 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43723e5a-8d53-451f-94a1-5c1e741b0fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:12.636474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723e5a-8d53-451f-94a1-5c1e741b0fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:12.636856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723e5a-8d53-451f-94a1-5c1e741b0fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:12.637280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723e5a-8d53-451f-94a1-5c1e741b0fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:12.638057 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43723e5a-8d53-451f-94a1-5c1e741b0fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:12.639928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43723e5a-8d53-451f-94a1-5c1e741b0fb0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:12.667071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 945/1881] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:12.668698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60feab-7ff4-450f-95d3-d9db24b181d2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:12.686184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60feab-7ff4-450f-95d3-d9db24b181d2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:12.702524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea25e1f-2f8c-42a6-9d62-22c3fc26af07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:12.704242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea25e1f-2f8c-42a6-9d62-22c3fc26af07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:12.704767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea25e1f-2f8c-42a6-9d62-22c3fc26af07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:12.705298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea25e1f-2f8c-42a6-9d62-22c3fc26af07 admin admin] PATH_INFO: `/v3/projects/e465046fb5a845a98f797d7a04fe3d97/users/3282effa4a924a0f8f2249f5850fa0ad/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:12.728739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea25e1f-2f8c-42a6-9d62-22c3fc26af07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e465046fb5a845a98f797d7a04fe3d97, user_id=3282effa4a924a0f8f2249f5850fa0ad, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:12.733127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea25e1f-2f8c-42a6-9d62-22c3fc26af07 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:12.837187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 937/1882] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:12 2022] PUT /identity/v3/projects/e465046fb5a845a98f797d7a04fe3d97/users/3282effa4a924a0f8f2249f5850fa0ad/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:12.847624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d9e25-c07a-42ef-be23-e9d2e8e82574 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:12.847909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d9e25-c07a-42ef-be23-e9d2e8e82574 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:12.848187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d9e25-c07a-42ef-be23-e9d2e8e82574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:12.902193 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3f5d9e25-c07a-42ef-be23-e9d2e8e82574 None None] MFA Rules not processed for user `3282effa4a924a0f8f2249f5850fa0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:12.903689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3f5d9e25-c07a-42ef-be23-e9d2e8e82574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:13.013293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 946/1883] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:13.014801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea25e1f-2f8c-42a6-9d62-22c3fc26af07 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:13.118239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea25e1f-2f8c-42a6-9d62-22c3fc26af07 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:13.127493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e3268-111e-48cb-a204-2affc5f6d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:13.128796 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3268-111e-48cb-a204-2affc5f6d505 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:13.128951 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:13.129559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3268-111e-48cb-a204-2affc5f6d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:13.140724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3268-111e-48cb-a204-2affc5f6d505 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:13.140724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e3268-111e-48cb-a204-2affc5f6d505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:13.140724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e3268-111e-48cb-a204-2affc5f6d505 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:13.273695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 938/1884] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:13 2022] POST /identity/v3/projects => generated 365 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:13.278846 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d9e25-c07a-42ef-be23-e9d2e8e82574 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:13.306363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d9e25-c07a-42ef-be23-e9d2e8e82574 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:13.440059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cadb26-fe11-4fc7-8d76-cfa30442b83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:13.440697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cadb26-fe11-4fc7-8d76-cfa30442b83b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:13.440982 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cadb26-fe11-4fc7-8d76-cfa30442b83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:13.441257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cadb26-fe11-4fc7-8d76-cfa30442b83b admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:13.442003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cadb26-fe11-4fc7-8d76-cfa30442b83b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:13.452190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cadb26-fe11-4fc7-8d76-cfa30442b83b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:13.644013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 947/1885] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:13 2022] POST /identity/v3/users => generated 289 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:13.647823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e3268-111e-48cb-a204-2affc5f6d505 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:13.665400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e3268-111e-48cb-a204-2affc5f6d505 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:13.678667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913be1d-0c24-4486-8715-fac4432a6283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:13.680318 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913be1d-0c24-4486-8715-fac4432a6283 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:13.680838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913be1d-0c24-4486-8715-fac4432a6283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:13.681336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913be1d-0c24-4486-8715-fac4432a6283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:13.682982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913be1d-0c24-4486-8715-fac4432a6283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:13.685720 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913be1d-0c24-4486-8715-fac4432a6283 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:13.704343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 939/1886] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:13.708837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cadb26-fe11-4fc7-8d76-cfa30442b83b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:13.721431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cadb26-fe11-4fc7-8d76-cfa30442b83b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:13.736501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e117593-716b-4d2b-82f8-2b5979063e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:13.737477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117593-716b-4d2b-82f8-2b5979063e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:13.737783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117593-716b-4d2b-82f8-2b5979063e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:13.738069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117593-716b-4d2b-82f8-2b5979063e34 admin admin] PATH_INFO: `/v3/projects/2482e6153c5d47f79477acb643ddb85b/users/e0c6cb0f2e4a463093b1105a8204bbb3/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:13.759973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e117593-716b-4d2b-82f8-2b5979063e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2482e6153c5d47f79477acb643ddb85b, user_id=e0c6cb0f2e4a463093b1105a8204bbb3, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:13.764443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e117593-716b-4d2b-82f8-2b5979063e34 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:13.859597 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 948/1887] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:13 2022] PUT /identity/v3/projects/2482e6153c5d47f79477acb643ddb85b/users/e0c6cb0f2e4a463093b1105a8204bbb3/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:13.864766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913be1d-0c24-4486-8715-fac4432a6283 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:13.889054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:13.894163 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913be1d-0c24-4486-8715-fac4432a6283 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:14.041405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4b07b-368a-4848-80ca-538fd5523434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:14.042135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b07b-368a-4848-80ca-538fd5523434 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:14.042453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b07b-368a-4848-80ca-538fd5523434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:14.042732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4b07b-368a-4848-80ca-538fd5523434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:14.043812 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4b07b-368a-4848-80ca-538fd5523434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:14.046209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4b07b-368a-4848-80ca-538fd5523434 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:14.062636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 940/1888] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:14.066864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e117593-716b-4d2b-82f8-2b5979063e34 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:14.082064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e117593-716b-4d2b-82f8-2b5979063e34 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:14.089459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb97f78-0ab7-430a-9925-4ec9566248a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:14.089459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb97f78-0ab7-430a-9925-4ec9566248a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:14.089459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb97f78-0ab7-430a-9925-4ec9566248a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:14.089459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb97f78-0ab7-430a-9925-4ec9566248a3 admin admin] PATH_INFO: `/v3/projects/2482e6153c5d47f79477acb643ddb85b/users/e0c6cb0f2e4a463093b1105a8204bbb3/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:14.091716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb97f78-0ab7-430a-9925-4ec9566248a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2482e6153c5d47f79477acb643ddb85b, user_id=e0c6cb0f2e4a463093b1105a8204bbb3, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:14.094508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb97f78-0ab7-430a-9925-4ec9566248a3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:14.107867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 949/1889] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:14 2022] PUT /identity/v3/projects/2482e6153c5d47f79477acb643ddb85b/users/e0c6cb0f2e4a463093b1105a8204bbb3/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:14.119997 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103e6c-d4b7-4d71-802d-c5ae57feff6f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:14.123616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103e6c-d4b7-4d71-802d-c5ae57feff6f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:14.123616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103e6c-d4b7-4d71-802d-c5ae57feff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:14.170212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-32103e6c-d4b7-4d71-802d-c5ae57feff6f None None] MFA Rules not processed for user `e0c6cb0f2e4a463093b1105a8204bbb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:14.171356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-32103e6c-d4b7-4d71-802d-c5ae57feff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:14.295413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 941/1890] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:14.339851 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb97f78-0ab7-430a-9925-4ec9566248a3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:14.463159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb97f78-0ab7-430a-9925-4ec9566248a3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:14.470159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e55963-b04c-4c34-afdb-df096b41a38f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:14.477246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55963-b04c-4c34-afdb-df096b41a38f service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:14.477246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55963-b04c-4c34-afdb-df096b41a38f service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:14.477246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55963-b04c-4c34-afdb-df096b41a38f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:14.494658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e55963-b04c-4c34-afdb-df096b41a38f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:14.498211 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e55963-b04c-4c34-afdb-df096b41a38f service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:14.511926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 950/1891] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:15.021666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103e6c-d4b7-4d71-802d-c5ae57feff6f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:15.035622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103e6c-d4b7-4d71-802d-c5ae57feff6f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:15.052574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfa733-adcb-451b-a764-e842d361558c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:15.053216 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfa733-adcb-451b-a764-e842d361558c service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:15.053518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfa733-adcb-451b-a764-e842d361558c service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:15.053786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfa733-adcb-451b-a764-e842d361558c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:15.171819 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dfa733-adcb-451b-a764-e842d361558c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:15.174888 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dfa733-adcb-451b-a764-e842d361558c service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:15.197007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 942/1892] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:15.239898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:15.928634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:17.147129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:17.227778 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:18.141847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e55963-b04c-4c34-afdb-df096b41a38f service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:18.156839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e55963-b04c-4c34-afdb-df096b41a38f service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:18.168830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab490f12-5655-4283-b3a4-7d1b49b1084f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:18.169739 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab490f12-5655-4283-b3a4-7d1b49b1084f service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:18.170088 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab490f12-5655-4283-b3a4-7d1b49b1084f service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:18.170436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab490f12-5655-4283-b3a4-7d1b49b1084f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:18.172410 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ab490f12-5655-4283-b3a4-7d1b49b1084f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:18.247129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab490f12-5655-4283-b3a4-7d1b49b1084f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:18.248587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab490f12-5655-4283-b3a4-7d1b49b1084f service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:18.254678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:18.262462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 951/1893] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:18.896609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:19.291253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:20.295712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:20.398361 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:20.794102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfa733-adcb-451b-a764-e842d361558c service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:20.795846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-90dfa733-adcb-451b-a764-e842d361558c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:20.877188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfa733-adcb-451b-a764-e842d361558c service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:20.883227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:20.884052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:20.884557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:20.885086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] PATH_INFO: `/v3/users/1c530462d67c435c99ba4dc694641f98` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:20.886471 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c530462d67c435c99ba4dc694641f98)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:20.892302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:21.169376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c530462d67c435c99ba4dc694641f98'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:21.170137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c530462d67c435c99ba4dc694641f98'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:21.177199 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c530462d67c435c99ba4dc694641f98'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:21.192324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c530462d67c435c99ba4dc694641f98'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:21.290244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c530462d67c435c99ba4dc694641f98'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:21.302490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 943/1894] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:20 2022] DELETE /identity/v3/users/1c530462d67c435c99ba4dc694641f98 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:21.306009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727d1f-d5fa-4d44-9a8d-6ee679ab6e93 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:21.306487 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727d1f-d5fa-4d44-9a8d-6ee679ab6e93 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:21.306745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727d1f-d5fa-4d44-9a8d-6ee679ab6e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:21.335984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-37727d1f-d5fa-4d44-9a8d-6ee679ab6e93 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:21.335984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-37727d1f-d5fa-4d44-9a8d-6ee679ab6e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:21.403937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 952/1895] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:21.416009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:21.418419 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:21.487014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1ba42-ca32-473f-83be-c060a0c439fe admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:21.492390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c08a99-fa81-4ad3-9429-3d03509e0b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:21.492916 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c08a99-fa81-4ad3-9429-3d03509e0b19 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:21.493189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c08a99-fa81-4ad3-9429-3d03509e0b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:21.493491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c08a99-fa81-4ad3-9429-3d03509e0b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:21.504234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c08a99-fa81-4ad3-9429-3d03509e0b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:21.505714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c08a99-fa81-4ad3-9429-3d03509e0b19 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:21.515843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 944/1896] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:21.760087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:21.878428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29a1a-4d23-42ca-90a0-86f02e7a199d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:21.878821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29a1a-4d23-42ca-90a0-86f02e7a199d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:21.879285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29a1a-4d23-42ca-90a0-86f02e7a199d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:21.881981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 953/1897] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 17 16:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:24:21.932551 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:21.958957 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb538f04-38e0-4828-95c1-a1dc97df9a2c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:21.959438 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb538f04-38e0-4828-95c1-a1dc97df9a2c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:21.960442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb538f04-38e0-4828-95c1-a1dc97df9a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:22.015513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-cb538f04-38e0-4828-95c1-a1dc97df9a2c None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:22.016982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cb538f04-38e0-4828-95c1-a1dc97df9a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:22.104352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29a1a-4d23-42ca-90a0-86f02e7a199d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:22.104352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4de29a1a-4d23-42ca-90a0-86f02e7a199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:22.123551 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 945/1898] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 17 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:22.131624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29a1a-4d23-42ca-90a0-86f02e7a199d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:22.137152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:22.137855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:22.138101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:22.138377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] PATH_INFO: `/v3/projects/1201c83920184c6d899c9b8f3a82cfc1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:22.140212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1201c83920184c6d899c9b8f3a82cfc1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:22.142207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:22.169739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb538f04-38e0-4828-95c1-a1dc97df9a2c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:22.172313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cb538f04-38e0-4828-95c1-a1dc97df9a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:22.223309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb538f04-38e0-4828-95c1-a1dc97df9a2c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:22.229213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdbbe6-89cf-4963-9c53-398609a970e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:22.230557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdbbe6-89cf-4963-9c53-398609a970e7 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:22.230557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdbbe6-89cf-4963-9c53-398609a970e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:22.230557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdbbe6-89cf-4963-9c53-398609a970e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:22.239827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdbbe6-89cf-4963-9c53-398609a970e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:22.242586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdbbe6-89cf-4963-9c53-398609a970e7 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:22.254409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 946/1899] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:22.307415 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1201c83920184c6d899c9b8f3a82cfc1', 'request_id': 'req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:22.315886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1201c83920184c6d899c9b8f3a82cfc1', 'request_id': 'req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:22.330364 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1201c83920184c6d899c9b8f3a82cfc1', 'request_id': 'req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:22.409854 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] The token cache is being invalidate because project 1201c83920184c6d899c9b8f3a82cfc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:22.410566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:22.411756 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:22.417401 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 954/1900] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:22 2022] DELETE /identity/v3/projects/1201c83920184c6d899c9b8f3a82cfc1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:22.419662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdbbe6-89cf-4963-9c53-398609a970e7 service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:22.432437 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdbbe6-89cf-4963-9c53-398609a970e7 service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:22.497744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:22.498420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:22.498685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:22.498951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] PATH_INFO: `/v3/users/bc30a87dd4bb4992bc1bb478cef3db8d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:22.500115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc30a87dd4bb4992bc1bb478cef3db8d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:22.502152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:22.745808 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc30a87dd4bb4992bc1bb478cef3db8d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:22.746722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc30a87dd4bb4992bc1bb478cef3db8d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:22.753683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc30a87dd4bb4992bc1bb478cef3db8d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:22.766828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:22.768352 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc30a87dd4bb4992bc1bb478cef3db8d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:22.866979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc30a87dd4bb4992bc1bb478cef3db8d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:22.875617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 947/1901] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:22 2022] DELETE /identity/v3/users/bc30a87dd4bb4992bc1bb478cef3db8d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:23.420412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:23.421962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:23.435162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ddf9-b2d3-4c3b-bdfb-0880f2501644 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:23.453685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:23.455654 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:23.529596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222edb71-f957-482c-accd-3bc016b29e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:23.530589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222edb71-f957-482c-accd-3bc016b29e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:23.531128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222edb71-f957-482c-accd-3bc016b29e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:23.531552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222edb71-f957-482c-accd-3bc016b29e0a admin admin] PATH_INFO: `/v3/users/69704454bbd44562834e42b4d1a901c8` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:23.533185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222edb71-f957-482c-accd-3bc016b29e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69704454bbd44562834e42b4d1a901c8)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:23.535286 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222edb71-f957-482c-accd-3bc016b29e0a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:23.575536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb1c78-8f0b-4667-b051-275d1ce504ba admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:23.584371 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:23.585772 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:23.586139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:23.586593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] PATH_INFO: `/v3/projects/860642e036794477ab00f7bc67610c60` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:23.587824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=860642e036794477ab00f7bc67610c60)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:23.589870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:23.771619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-222edb71-f957-482c-accd-3bc016b29e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69704454bbd44562834e42b4d1a901c8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:23.772408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-222edb71-f957-482c-accd-3bc016b29e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69704454bbd44562834e42b4d1a901c8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:23.781130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860642e036794477ab00f7bc67610c60', 'request_id': 'req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:23.786963 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860642e036794477ab00f7bc67610c60', 'request_id': 'req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:23.789118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-222edb71-f957-482c-accd-3bc016b29e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69704454bbd44562834e42b4d1a901c8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:23.795914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-222edb71-f957-482c-accd-3bc016b29e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69704454bbd44562834e42b4d1a901c8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:23.796652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-222edb71-f957-482c-accd-3bc016b29e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69704454bbd44562834e42b4d1a901c8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:23.850531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860642e036794477ab00f7bc67610c60', 'request_id': 'req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:23.863161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] The token cache is being invalidate because project 860642e036794477ab00f7bc67610c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:23.863450 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:23.864098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:23.865718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 948/1902] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:23 2022] DELETE /identity/v3/projects/860642e036794477ab00f7bc67610c60 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:23.869240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:23.869240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:23.942138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 955/1903] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:23 2022] DELETE /identity/v3/users/69704454bbd44562834e42b4d1a901c8 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:23.943591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981faf-6843-40d8-b6ea-257a1f03542e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:23.943876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981faf-6843-40d8-b6ea-257a1f03542e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:23.943980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6a2a4-12fc-48f8-8677-0d40caa51e26 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:23.945008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981faf-6843-40d8-b6ea-257a1f03542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:23.966024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-56981faf-6843-40d8-b6ea-257a1f03542e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:23.967233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-56981faf-6843-40d8-b6ea-257a1f03542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:24.005552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d6869-ab53-4fa7-835e-fb378d5de1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:24.006193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d6869-ab53-4fa7-835e-fb378d5de1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.006470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d6869-ab53-4fa7-835e-fb378d5de1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.007512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d6869-ab53-4fa7-835e-fb378d5de1ff admin admin] PATH_INFO: `/v3/users/3282effa4a924a0f8f2249f5850fa0ad` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.008926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d6869-ab53-4fa7-835e-fb378d5de1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3282effa4a924a0f8f2249f5850fa0ad)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:24.012396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d6869-ab53-4fa7-835e-fb378d5de1ff admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:24.037431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 956/1904] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:24.037431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee29a-7e83-4ec7-b20f-14dccfee3a54 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.037431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee29a-7e83-4ec7-b20f-14dccfee3a54 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.037431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee29a-7e83-4ec7-b20f-14dccfee3a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.052570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f93ee29a-7e83-4ec7-b20f-14dccfee3a54 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:24.054410 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f93ee29a-7e83-4ec7-b20f-14dccfee3a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:24.062006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 957/1905] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:24.064063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de74a3-d157-4adb-b11f-8e2ea1c1fed9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.064483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de74a3-d157-4adb-b11f-8e2ea1c1fed9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.064811 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de74a3-d157-4adb-b11f-8e2ea1c1fed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.086187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d2de74a3-d157-4adb-b11f-8e2ea1c1fed9 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:24.087587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d2de74a3-d157-4adb-b11f-8e2ea1c1fed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:24.095687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 958/1906] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:24.096547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de74a3-d157-4adb-b11f-8e2ea1c1fed9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:24.098022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d2de74a3-d157-4adb-b11f-8e2ea1c1fed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:24.158895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de74a3-d157-4adb-b11f-8e2ea1c1fed9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:24.162787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1adf0-ef24-48ec-a251-283ec78a4641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:24.163480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1adf0-ef24-48ec-a251-283ec78a4641 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.163758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1adf0-ef24-48ec-a251-283ec78a4641 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.164011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1adf0-ef24-48ec-a251-283ec78a4641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.174030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1adf0-ef24-48ec-a251-283ec78a4641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:24.175504 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1adf0-ef24-48ec-a251-283ec78a4641 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:24.181190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-481d6869-ab53-4fa7-835e-fb378d5de1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3282effa4a924a0f8f2249f5850fa0ad'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:24.181979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-481d6869-ab53-4fa7-835e-fb378d5de1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3282effa4a924a0f8f2249f5850fa0ad'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:24.185918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 959/1907] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:24.186817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1adf0-ef24-48ec-a251-283ec78a4641 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:24.190382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-481d6869-ab53-4fa7-835e-fb378d5de1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3282effa4a924a0f8f2249f5850fa0ad'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:24.196542 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:24.199654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1adf0-ef24-48ec-a251-283ec78a4641 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:24.205921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51281054-5494-4dfc-bd9c-bf797eee48b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:24.206731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51281054-5494-4dfc-bd9c-bf797eee48b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.207050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51281054-5494-4dfc-bd9c-bf797eee48b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.207323 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51281054-5494-4dfc-bd9c-bf797eee48b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.208281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51281054-5494-4dfc-bd9c-bf797eee48b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:24.208363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51281054-5494-4dfc-bd9c-bf797eee48b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:24.210415 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51281054-5494-4dfc-bd9c-bf797eee48b4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:24.224178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-481d6869-ab53-4fa7-835e-fb378d5de1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3282effa4a924a0f8f2249f5850fa0ad'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:24.245413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 960/1908] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:24.249878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51281054-5494-4dfc-bd9c-bf797eee48b4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:24.261661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51281054-5494-4dfc-bd9c-bf797eee48b4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:24.267004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f1a21-ae15-41f0-863d-9bf7e98859c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:24.267789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f1a21-ae15-41f0-863d-9bf7e98859c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.268218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f1a21-ae15-41f0-863d-9bf7e98859c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.271421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f1a21-ae15-41f0-863d-9bf7e98859c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.271421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f1a21-ae15-41f0-863d-9bf7e98859c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:24.271421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f1a21-ae15-41f0-863d-9bf7e98859c4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:24.325237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:24.326599 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-481d6869-ab53-4fa7-835e-fb378d5de1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3282effa4a924a0f8f2249f5850fa0ad'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:24.340983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 949/1909] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:23 2022] DELETE /identity/v3/users/3282effa4a924a0f8f2249f5850fa0ad => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:24.343179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd24c7a-43c3-403f-84f4-0318ca92e4d2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.343661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd24c7a-43c3-403f-84f4-0318ca92e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.344020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd24c7a-43c3-403f-84f4-0318ca92e4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.367480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-bfd24c7a-43c3-403f-84f4-0318ca92e4d2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:24.370063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bfd24c7a-43c3-403f-84f4-0318ca92e4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:24.394433 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 961/1910] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:24 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:24.399085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f1a21-ae15-41f0-863d-9bf7e98859c4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:24.407820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ea7f1a21-ae15-41f0-863d-9bf7e98859c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:24.484849 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 950/1911] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:24.504146 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd24c7a-43c3-403f-84f4-0318ca92e4d2 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:24.506339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bfd24c7a-43c3-403f-84f4-0318ca92e4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:24.593491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f1a21-ae15-41f0-863d-9bf7e98859c4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:24.600225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860812a-0e68-406f-901b-91fd1bf2b830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:24.601960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860812a-0e68-406f-901b-91fd1bf2b830 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.602735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860812a-0e68-406f-901b-91fd1bf2b830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.603211 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860812a-0e68-406f-901b-91fd1bf2b830 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.604044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860812a-0e68-406f-901b-91fd1bf2b830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:24.606808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860812a-0e68-406f-901b-91fd1bf2b830 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:24.640568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd24c7a-43c3-403f-84f4-0318ca92e4d2 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:24.708047 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899023-cf8f-485f-8f2e-5ed15e456bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:24.709625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899023-cf8f-485f-8f2e-5ed15e456bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.709625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899023-cf8f-485f-8f2e-5ed15e456bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.710208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899023-cf8f-485f-8f2e-5ed15e456bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.721375 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0899023-cf8f-485f-8f2e-5ed15e456bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:24.723051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0899023-cf8f-485f-8f2e-5ed15e456bf4 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:24.734690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 951/1912] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:24.738333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 962/1913] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:24 2022] POST /identity/v3/users => generated 289 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:24.741750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899023-cf8f-485f-8f2e-5ed15e456bf4 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:24.752481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899023-cf8f-485f-8f2e-5ed15e456bf4 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:24.759104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37eb8c4-37f7-453f-80b0-67ff39c92ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:24.759104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37eb8c4-37f7-453f-80b0-67ff39c92ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.759104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37eb8c4-37f7-453f-80b0-67ff39c92ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.759104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37eb8c4-37f7-453f-80b0-67ff39c92ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.759886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37eb8c4-37f7-453f-80b0-67ff39c92ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:24.761662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37eb8c4-37f7-453f-80b0-67ff39c92ab4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:24.775984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 952/1914] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:24.777563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860812a-0e68-406f-901b-91fd1bf2b830 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:24.789634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860812a-0e68-406f-901b-91fd1bf2b830 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:24.794633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebef17-d5a4-444f-a6ca-6d78d6665273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:24.796091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebef17-d5a4-444f-a6ca-6d78d6665273 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.796727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebef17-d5a4-444f-a6ca-6d78d6665273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.797214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebef17-d5a4-444f-a6ca-6d78d6665273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.798103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebef17-d5a4-444f-a6ca-6d78d6665273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:24.799875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebef17-d5a4-444f-a6ca-6d78d6665273 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:24.813063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 963/1915] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:24.816907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37eb8c4-37f7-453f-80b0-67ff39c92ab4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:24.846147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37eb8c4-37f7-453f-80b0-67ff39c92ab4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:24.856471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:24.864783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfb01e-6eea-4fad-b739-c6caef70f2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:24.865546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfb01e-6eea-4fad-b739-c6caef70f2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:24.865811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfb01e-6eea-4fad-b739-c6caef70f2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:24.866149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfb01e-6eea-4fad-b739-c6caef70f2b1 admin admin] PATH_INFO: `/v3/projects/95840ee759c44abbbd45f254078cc33f/users/a6d7132b64884e36aa0be6dc310d5912/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:24.901886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfb01e-6eea-4fad-b739-c6caef70f2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95840ee759c44abbbd45f254078cc33f, user_id=a6d7132b64884e36aa0be6dc310d5912, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:24.909336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfb01e-6eea-4fad-b739-c6caef70f2b1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:25.037279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebef17-d5a4-444f-a6ca-6d78d6665273 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:25.039771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-61ebef17-d5a4-444f-a6ca-6d78d6665273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:25.058719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebef17-d5a4-444f-a6ca-6d78d6665273 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:25.063590 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:25.064237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:25.064515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:25.070720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] PATH_INFO: `/v3/projects/2c76b8f6b547444bbf9d60e7185c25a8` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:25.070720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c76b8f6b547444bbf9d60e7185c25a8)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:25.070720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:25.097009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 953/1916] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:24 2022] PUT /identity/v3/projects/95840ee759c44abbbd45f254078cc33f/users/a6d7132b64884e36aa0be6dc310d5912/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:25.107904 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff448b-9b8d-44da-817f-590d3d9b22c4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:25.108185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff448b-9b8d-44da-817f-590d3d9b22c4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:25.108450 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff448b-9b8d-44da-817f-590d3d9b22c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:25.137939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-caff448b-9b8d-44da-817f-590d3d9b22c4 None None] MFA Rules not processed for user `a6d7132b64884e36aa0be6dc310d5912`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:25.139167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-caff448b-9b8d-44da-817f-590d3d9b22c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:25.198169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c76b8f6b547444bbf9d60e7185c25a8', 'request_id': 'req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.205894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c76b8f6b547444bbf9d60e7185c25a8', 'request_id': 'req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.213976 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c76b8f6b547444bbf9d60e7185c25a8', 'request_id': 'req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.233729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 954/1917] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:25.238162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff448b-9b8d-44da-817f-590d3d9b22c4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:25.295413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] The token cache is being invalidate because project 2c76b8f6b547444bbf9d60e7185c25a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:25.295937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.296829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.298707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 964/1918] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:25 2022] DELETE /identity/v3/projects/2c76b8f6b547444bbf9d60e7185c25a8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:25.302539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:25.304181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:25.308378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff448b-9b8d-44da-817f-590d3d9b22c4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:25.369151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ee69-a147-4e6b-8858-ca6eedfba4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:25.370152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ee69-a147-4e6b-8858-ca6eedfba4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:25.370580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ee69-a147-4e6b-8858-ca6eedfba4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:25.370986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ee69-a147-4e6b-8858-ca6eedfba4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:25.371814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396ee69-a147-4e6b-8858-ca6eedfba4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:25.373862 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396ee69-a147-4e6b-8858-ca6eedfba4c7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:25.374597 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728f5e9-0d27-4ef0-94f5-69ea089dd84c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:25.379608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:25.380267 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:25.384320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:25.384320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] PATH_INFO: `/v3/users/4216281daacc436fa8a7fa146992347e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:25.384320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4216281daacc436fa8a7fa146992347e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:25.384703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:25.488548 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 955/1919] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:25 2022] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:25.489700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ee69-a147-4e6b-8858-ca6eedfba4c7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:25.492093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5396ee69-a147-4e6b-8858-ca6eedfba4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:25.576336 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ee69-a147-4e6b-8858-ca6eedfba4c7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:25.581267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:25.582072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:25.582349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:25.582645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] PATH_INFO: `/v3/projects/e465046fb5a845a98f797d7a04fe3d97` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:25.583805 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e465046fb5a845a98f797d7a04fe3d97)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:25.586457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:25.655376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4216281daacc436fa8a7fa146992347e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.656642 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4216281daacc436fa8a7fa146992347e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.673217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4216281daacc436fa8a7fa146992347e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.682897 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4216281daacc436fa8a7fa146992347e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.683882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4216281daacc436fa8a7fa146992347e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.754709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e465046fb5a845a98f797d7a04fe3d97', 'request_id': 'req-ecd9b7d4-e731-4206-88c4-55879c2d185d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.763909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e465046fb5a845a98f797d7a04fe3d97', 'request_id': 'req-ecd9b7d4-e731-4206-88c4-55879c2d185d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.783010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 965/1920] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:25 2022] DELETE /identity/v3/users/4216281daacc436fa8a7fa146992347e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:25.786612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:25.786612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:25.884231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e465046fb5a845a98f797d7a04fe3d97', 'request_id': 'req-ecd9b7d4-e731-4206-88c4-55879c2d185d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.921713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] The token cache is being invalidate because project e465046fb5a845a98f797d7a04fe3d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:25.931290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.933561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:25.934705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:25.936965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 956/1921] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:25 2022] DELETE /identity/v3/projects/e465046fb5a845a98f797d7a04fe3d97 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:25.945553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:25.946140 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfd4ff-b3e7-493a-ade0-ca48b4f468f9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:25.950296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:25.957161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf9f32-46c2-4c2e-ab9a-f79bd21af358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:25.961635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf9f32-46c2-4c2e-ab9a-f79bd21af358 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:25.962246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf9f32-46c2-4c2e-ab9a-f79bd21af358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:25.962695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf9f32-46c2-4c2e-ab9a-f79bd21af358 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:25.963723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf9f32-46c2-4c2e-ab9a-f79bd21af358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:25.968732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf9f32-46c2-4c2e-ab9a-f79bd21af358 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:26.028092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9b7d4-e731-4206-88c4-55879c2d185d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:26.032943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:26.033610 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:26.033887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:26.034156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] PATH_INFO: `/v3/users/e0c6cb0f2e4a463093b1105a8204bbb3` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:26.035297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c6cb0f2e4a463093b1105a8204bbb3)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:26.037504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:26.057206 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 966/1922] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:25 2022] POST /identity/v3/users => generated 296 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:26.060488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf9f32-46c2-4c2e-ab9a-f79bd21af358 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:26.068116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b9cf9f32-46c2-4c2e-ab9a-f79bd21af358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:26.086997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf9f32-46c2-4c2e-ab9a-f79bd21af358 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:26.092794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec27f4-4bfd-4458-be9d-bca4901a5071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:26.093116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec27f4-4bfd-4458-be9d-bca4901a5071 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:26.093468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec27f4-4bfd-4458-be9d-bca4901a5071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:26.093711 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec27f4-4bfd-4458-be9d-bca4901a5071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:26.094366 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec27f4-4bfd-4458-be9d-bca4901a5071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:26.096413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec27f4-4bfd-4458-be9d-bca4901a5071 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:26.108603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 967/1923] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:26.115339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec27f4-4bfd-4458-be9d-bca4901a5071 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:26.127515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec27f4-4bfd-4458-be9d-bca4901a5071 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:26.133666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7468fe-75ef-40de-9c55-25c051f5cf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:26.134346 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7468fe-75ef-40de-9c55-25c051f5cf3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:26.134697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7468fe-75ef-40de-9c55-25c051f5cf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:26.135047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7468fe-75ef-40de-9c55-25c051f5cf3d admin admin] PATH_INFO: `/v3/projects/b9311aa871db48d69311faba925e19b0/users/01dde55b1cf0426aab50d52e968b2e1d/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:26.158054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7468fe-75ef-40de-9c55-25c051f5cf3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9311aa871db48d69311faba925e19b0, user_id=01dde55b1cf0426aab50d52e968b2e1d, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:26.161235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7468fe-75ef-40de-9c55-25c051f5cf3d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:26.205751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c6cb0f2e4a463093b1105a8204bbb3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:26.206431 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c6cb0f2e4a463093b1105a8204bbb3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:26.215865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c6cb0f2e4a463093b1105a8204bbb3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:26.230630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c6cb0f2e4a463093b1105a8204bbb3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:26.268070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 968/1924] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:26 2022] PUT /identity/v3/projects/b9311aa871db48d69311faba925e19b0/users/01dde55b1cf0426aab50d52e968b2e1d/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:26.273118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7468fe-75ef-40de-9c55-25c051f5cf3d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:26.295042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c6cb0f2e4a463093b1105a8204bbb3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:26.306124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 957/1925] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:25 2022] DELETE /identity/v3/users/e0c6cb0f2e4a463093b1105a8204bbb3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:26.348185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7468fe-75ef-40de-9c55-25c051f5cf3d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:26.373289 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:26.376032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:26.424929 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65ac45-5d7c-4558-93ee-6d95dd567cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:26.426205 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65ac45-5d7c-4558-93ee-6d95dd567cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:26.426205 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65ac45-5d7c-4558-93ee-6d95dd567cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:26.426404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65ac45-5d7c-4558-93ee-6d95dd567cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:26.427196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65ac45-5d7c-4558-93ee-6d95dd567cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:26.430228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65ac45-5d7c-4558-93ee-6d95dd567cf2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:26.449293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 969/1926] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:26.450355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65ac45-5d7c-4558-93ee-6d95dd567cf2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:26.452128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aa65ac45-5d7c-4558-93ee-6d95dd567cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:26.466441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65ac45-5d7c-4558-93ee-6d95dd567cf2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:26.471522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521766e-9998-4766-8fdf-c2bcfcf3edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:26.472213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521766e-9998-4766-8fdf-c2bcfcf3edf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:26.472491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521766e-9998-4766-8fdf-c2bcfcf3edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:26.472793 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521766e-9998-4766-8fdf-c2bcfcf3edf1 admin admin] PATH_INFO: `/v3/projects/b9311aa871db48d69311faba925e19b0/users/01dde55b1cf0426aab50d52e968b2e1d/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:26.474836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521766e-9998-4766-8fdf-c2bcfcf3edf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9311aa871db48d69311faba925e19b0, user_id=01dde55b1cf0426aab50d52e968b2e1d, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:26.477663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521766e-9998-4766-8fdf-c2bcfcf3edf1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:26.489192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 970/1927] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:26 2022] PUT /identity/v3/projects/b9311aa871db48d69311faba925e19b0/users/01dde55b1cf0426aab50d52e968b2e1d/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:26.500457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425970d-1ea3-47b7-a1ed-d6634fc3c9dc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:26.500754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425970d-1ea3-47b7-a1ed-d6634fc3c9dc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:26.501010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425970d-1ea3-47b7-a1ed-d6634fc3c9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:26.505642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad14329-5bd4-4813-a5d9-96be4d75a1dd admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:26.532311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1425970d-1ea3-47b7-a1ed-d6634fc3c9dc None None] MFA Rules not processed for user `01dde55b1cf0426aab50d52e968b2e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:26.533646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1425970d-1ea3-47b7-a1ed-d6634fc3c9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:26.590556 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:26.591209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:26.591482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:26.593200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] PATH_INFO: `/v3/projects/f5efae72c84b472794e0ef1ef5f5ee70` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:26.593972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5efae72c84b472794e0ef1ef5f5ee70)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:26.596341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:26.648608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 971/1928] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:26.661243 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425970d-1ea3-47b7-a1ed-d6634fc3c9dc None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:26.663780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1425970d-1ea3-47b7-a1ed-d6634fc3c9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:26.731311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5efae72c84b472794e0ef1ef5f5ee70', 'request_id': 'req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:26.744528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5efae72c84b472794e0ef1ef5f5ee70', 'request_id': 'req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:26.747571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425970d-1ea3-47b7-a1ed-d6634fc3c9dc None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:26.807570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a2154-c087-45cb-8c94-e3d7e3c09ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:26.808180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a2154-c087-45cb-8c94-e3d7e3c09ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:26.808507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a2154-c087-45cb-8c94-e3d7e3c09ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:26.808771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a2154-c087-45cb-8c94-e3d7e3c09ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:26.810701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cf0a2154-c087-45cb-8c94-e3d7e3c09ea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:26.844450 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5efae72c84b472794e0ef1ef5f5ee70', 'request_id': 'req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:26.863727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] The token cache is being invalidate because project f5efae72c84b472794e0ef1ef5f5ee70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:26.864032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:26.865552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:26.867789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 958/1929] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:26 2022] DELETE /identity/v3/projects/f5efae72c84b472794e0ef1ef5f5ee70 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:26.868535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:26.869970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:26.905648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a2154-c087-45cb-8c94-e3d7e3c09ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:26.907288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a2154-c087-45cb-8c94-e3d7e3c09ea4 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:26.920225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 972/1930] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:26.921167 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a2154-c087-45cb-8c94-e3d7e3c09ea4 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:26.990347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8159f3-c78a-4e5e-9438-a6937fc3fa2b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:27.007851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:27.008515 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:27.008792 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:27.009064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] PATH_INFO: `/v3/projects/2482e6153c5d47f79477acb643ddb85b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:27.012291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2482e6153c5d47f79477acb643ddb85b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:27.014328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:27.056386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a2154-c087-45cb-8c94-e3d7e3c09ea4 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:27.065761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:27.066549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:27.066902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:27.067159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] PATH_INFO: `/v3/users/14a85260915f440f8fdc3e89b67a9e78` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:27.068233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a85260915f440f8fdc3e89b67a9e78)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:27.071549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:27.142977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:27.171027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2482e6153c5d47f79477acb643ddb85b', 'request_id': 'req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:27.178143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2482e6153c5d47f79477acb643ddb85b', 'request_id': 'req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:27.284645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2482e6153c5d47f79477acb643ddb85b', 'request_id': 'req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:27.305456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] The token cache is being invalidate because project 2482e6153c5d47f79477acb643ddb85b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:27.305800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:27.307229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bb5c1f56-45c9-4644-abe8-0ecb5adc834b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:27.309534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 959/1931] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:26 2022] DELETE /identity/v3/projects/2482e6153c5d47f79477acb643ddb85b => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:27.314324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07da8e-9a05-472d-9cbe-620a23ef7896 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:27.314680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07da8e-9a05-472d-9cbe-620a23ef7896 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:27.315064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07da8e-9a05-472d-9cbe-620a23ef7896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:27.341795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-bd07da8e-9a05-472d-9cbe-620a23ef7896 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:27.343151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bd07da8e-9a05-472d-9cbe-620a23ef7896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:27.361179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a85260915f440f8fdc3e89b67a9e78'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:27.362402 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a85260915f440f8fdc3e89b67a9e78'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:27.397568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a85260915f440f8fdc3e89b67a9e78'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:27.431840 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a85260915f440f8fdc3e89b67a9e78'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:27.436089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a85260915f440f8fdc3e89b67a9e78'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:27.453671 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 960/1932] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:27.461467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32fee5-3c5c-4015-9be5-bb786c10a1a1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:27.461760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32fee5-3c5c-4015-9be5-bb786c10a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:27.462034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32fee5-3c5c-4015-9be5-bb786c10a1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:27.481907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2f32fee5-3c5c-4015-9be5-bb786c10a1a1 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:27.483130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2f32fee5-3c5c-4015-9be5-bb786c10a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:27.492727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 961/1933] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:27.496800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32fee5-3c5c-4015-9be5-bb786c10a1a1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:27.506207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32fee5-3c5c-4015-9be5-bb786c10a1a1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:27.516493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaefe4-9d05-482d-947e-6ac35971744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:27.517067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaefe4-9d05-482d-947e-6ac35971744e admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:27.517386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaefe4-9d05-482d-947e-6ac35971744e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:27.517661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaefe4-9d05-482d-947e-6ac35971744e admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:27.518376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaefe4-9d05-482d-947e-6ac35971744e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:27.518678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaefe4-9d05-482d-947e-6ac35971744e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:27.525050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaefe4-9d05-482d-947e-6ac35971744e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:27.535251 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 962/1934] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:24:27.541458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaefe4-9d05-482d-947e-6ac35971744e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:27.554436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaefe4-9d05-482d-947e-6ac35971744e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:27.557475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 973/1935] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:26 2022] DELETE /identity/v3/users/14a85260915f440f8fdc3e89b67a9e78 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:27.629691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225451d-6b11-4c13-b087-28ddcb9c23cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:27.630392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225451d-6b11-4c13-b087-28ddcb9c23cc admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:27.630690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225451d-6b11-4c13-b087-28ddcb9c23cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:27.631088 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225451d-6b11-4c13-b087-28ddcb9c23cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:27.631838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225451d-6b11-4c13-b087-28ddcb9c23cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:27.633784 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225451d-6b11-4c13-b087-28ddcb9c23cc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:27.739634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 963/1936] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:27 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:27.741464 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:27.759769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0360d-cea1-44d1-8c85-2c2c3c0a83dc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:27.916107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bde47-e135-4124-b56a-6e31c383ec12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:27.916758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bde47-e135-4124-b56a-6e31c383ec12 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:27.917037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bde47-e135-4124-b56a-6e31c383ec12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:27.917306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bde47-e135-4124-b56a-6e31c383ec12 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:27.922549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bde47-e135-4124-b56a-6e31c383ec12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:27.927040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bde47-e135-4124-b56a-6e31c383ec12 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:28.096366 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 974/1937] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:27 2022] POST /identity/v3/users => generated 286 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:28.097662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225451d-6b11-4c13-b087-28ddcb9c23cc admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:28.117953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225451d-6b11-4c13-b087-28ddcb9c23cc admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:28.131323 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494a53b-ba78-4ef5-bcef-7c46bd9e5993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:28.132887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494a53b-ba78-4ef5-bcef-7c46bd9e5993 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.133401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494a53b-ba78-4ef5-bcef-7c46bd9e5993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.133749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494a53b-ba78-4ef5-bcef-7c46bd9e5993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:28.134420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494a53b-ba78-4ef5-bcef-7c46bd9e5993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:28.137560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494a53b-ba78-4ef5-bcef-7c46bd9e5993 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:28.159173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 964/1938] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:28.159530 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bde47-e135-4124-b56a-6e31c383ec12 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:28.170880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bde47-e135-4124-b56a-6e31c383ec12 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:28.181870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494a53b-ba78-4ef5-bcef-7c46bd9e5993 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:28.187450 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c28434-3e68-4dbd-9e76-f1683c29db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:28.188148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c28434-3e68-4dbd-9e76-f1683c29db68 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.188439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c28434-3e68-4dbd-9e76-f1683c29db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.188700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c28434-3e68-4dbd-9e76-f1683c29db68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:28.189350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c28434-3e68-4dbd-9e76-f1683c29db68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:28.191559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9494a53b-ba78-4ef5-bcef-7c46bd9e5993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:28.191701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c28434-3e68-4dbd-9e76-f1683c29db68 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:28.216432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 975/1939] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:28.216651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494a53b-ba78-4ef5-bcef-7c46bd9e5993 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:28.217589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c28434-3e68-4dbd-9e76-f1683c29db68 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:28.221999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:28.222738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.223118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.223459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] PATH_INFO: `/v3/projects/2e928bea0f624e65ac42b88824cd6dea` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:28.224932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e928bea0f624e65ac42b88824cd6dea)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:28.228679 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:28.237088 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c28434-3e68-4dbd-9e76-f1683c29db68 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:28.244451 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:28.250834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3245e-221d-4aa7-97b0-416f07b181d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:28.253717 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3245e-221d-4aa7-97b0-416f07b181d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.254582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3245e-221d-4aa7-97b0-416f07b181d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.257090 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3245e-221d-4aa7-97b0-416f07b181d6 admin admin] PATH_INFO: `/v3/projects/955ef703ee9c4b6393804c7255dc0192/users/1b51714670574bd2abae3e8560d44092/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:28.277977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3245e-221d-4aa7-97b0-416f07b181d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955ef703ee9c4b6393804c7255dc0192, user_id=1b51714670574bd2abae3e8560d44092, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:28.282055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3245e-221d-4aa7-97b0-416f07b181d6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:28.381035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 976/1940] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:28 2022] PUT /identity/v3/projects/955ef703ee9c4b6393804c7255dc0192/users/1b51714670574bd2abae3e8560d44092/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:28.391288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e928bea0f624e65ac42b88824cd6dea', 'request_id': 'req-2048c7e9-a686-4e99-a36b-8deea4c7642f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:28.391787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34ff3-968e-4742-bfb5-9969490a976e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.392071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34ff3-968e-4742-bfb5-9969490a976e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.392347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a34ff3-968e-4742-bfb5-9969490a976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:28.399848 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e928bea0f624e65ac42b88824cd6dea', 'request_id': 'req-2048c7e9-a686-4e99-a36b-8deea4c7642f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:28.422501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d2a34ff3-968e-4742-bfb5-9969490a976e None None] MFA Rules not processed for user `1b51714670574bd2abae3e8560d44092`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:28.423729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d2a34ff3-968e-4742-bfb5-9969490a976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:28.493874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 977/1941] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:28.502673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e928bea0f624e65ac42b88824cd6dea', 'request_id': 'req-2048c7e9-a686-4e99-a36b-8deea4c7642f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:28.506019 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a34ff3-968e-4742-bfb5-9969490a976e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:28.509881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d2a34ff3-968e-4742-bfb5-9969490a976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:28.519043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] The token cache is being invalidate because project 2e928bea0f624e65ac42b88824cd6dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:28.519941 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:28.520673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2048c7e9-a686-4e99-a36b-8deea4c7642f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:28.523345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 965/1942] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:28 2022] DELETE /identity/v3/projects/2e928bea0f624e65ac42b88824cd6dea => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:28.529237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e87690-1179-4cb0-9056-43c81ef8bd3b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.530332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e87690-1179-4cb0-9056-43c81ef8bd3b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.530802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e87690-1179-4cb0-9056-43c81ef8bd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:28.558207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-63e87690-1179-4cb0-9056-43c81ef8bd3b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:28.559773 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-63e87690-1179-4cb0-9056-43c81ef8bd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:28.582977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a34ff3-968e-4742-bfb5-9969490a976e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:28.587688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7dddc-99f9-4ce6-b5b0-c02f2d6cb275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:28.588362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7dddc-99f9-4ce6-b5b0-c02f2d6cb275 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.588644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7dddc-99f9-4ce6-b5b0-c02f2d6cb275 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.588972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7dddc-99f9-4ce6-b5b0-c02f2d6cb275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:28.591416 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f4d7dddc-99f9-4ce6-b5b0-c02f2d6cb275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:28.605868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7dddc-99f9-4ce6-b5b0-c02f2d6cb275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:28.607478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7dddc-99f9-4ce6-b5b0-c02f2d6cb275 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:28.623418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 978/1943] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:28.634432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:28.649392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7dddc-99f9-4ce6-b5b0-c02f2d6cb275 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:28.652852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f4d7dddc-99f9-4ce6-b5b0-c02f2d6cb275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:28.680320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 966/1944] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:28.682482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ebf1d-6be3-492f-afef-54730d292474 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.683076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ebf1d-6be3-492f-afef-54730d292474 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.683197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ebf1d-6be3-492f-afef-54730d292474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:28.723008 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5f0ebf1d-6be3-492f-afef-54730d292474 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:28.724456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5f0ebf1d-6be3-492f-afef-54730d292474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:28.735202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 967/1945] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:28.739253 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ebf1d-6be3-492f-afef-54730d292474 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:28.755166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ebf1d-6be3-492f-afef-54730d292474 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:28.755477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7dddc-99f9-4ce6-b5b0-c02f2d6cb275 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:28.761468 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ce2c8-a1d9-4223-b100-a79814412bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:28.762196 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce2c8-a1d9-4223-b100-a79814412bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.762476 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce2c8-a1d9-4223-b100-a79814412bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.762589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8061-65be-400a-a08e-1d4daadfd6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:28.762746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce2c8-a1d9-4223-b100-a79814412bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:28.763606 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8061-65be-400a-a08e-1d4daadfd6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.763896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8061-65be-400a-a08e-1d4daadfd6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.764178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8061-65be-400a-a08e-1d4daadfd6cb admin admin] PATH_INFO: `/v3/users/1b51714670574bd2abae3e8560d44092` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:28.766128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8061-65be-400a-a08e-1d4daadfd6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b51714670574bd2abae3e8560d44092)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:28.768089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8061-65be-400a-a08e-1d4daadfd6cb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:28.770405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ce2c8-a1d9-4223-b100-a79814412bb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:28.770948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ce2c8-a1d9-4223-b100-a79814412bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:28.773491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ce2c8-a1d9-4223-b100-a79814412bb5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:28.791175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 968/1946] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:28.802386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ce2c8-a1d9-4223-b100-a79814412bb5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:28.816789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ce2c8-a1d9-4223-b100-a79814412bb5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:28.822629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962563-d655-4ec6-acfd-573f17e06b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:28.823243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962563-d655-4ec6-acfd-573f17e06b19 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.823523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962563-d655-4ec6-acfd-573f17e06b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.823794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962563-d655-4ec6-acfd-573f17e06b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:28.824420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77962563-d655-4ec6-acfd-573f17e06b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:28.826483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77962563-d655-4ec6-acfd-573f17e06b19 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:28.926318 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 969/1947] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:28 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:28.930698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962563-d655-4ec6-acfd-573f17e06b19 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:28.993776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962563-d655-4ec6-acfd-573f17e06b19 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:28.998783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d339e-2001-4b28-b30a-d04af8196c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:28.999356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d339e-2001-4b28-b30a-d04af8196c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:28.999645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d339e-2001-4b28-b30a-d04af8196c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:28.999896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d339e-2001-4b28-b30a-d04af8196c23 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:29.000523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d339e-2001-4b28-b30a-d04af8196c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:29.002596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d339e-2001-4b28-b30a-d04af8196c23 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:29.039481 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a1da8061-65be-400a-a08e-1d4daadfd6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b51714670574bd2abae3e8560d44092'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:29.040619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a1da8061-65be-400a-a08e-1d4daadfd6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b51714670574bd2abae3e8560d44092'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:29.067178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a1da8061-65be-400a-a08e-1d4daadfd6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b51714670574bd2abae3e8560d44092'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:29.075349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a1da8061-65be-400a-a08e-1d4daadfd6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b51714670574bd2abae3e8560d44092'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:29.076196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a1da8061-65be-400a-a08e-1d4daadfd6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b51714670574bd2abae3e8560d44092'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:29.141406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 970/1948] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:28 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:29.142424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d339e-2001-4b28-b30a-d04af8196c23 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:29.148408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ab4d339e-2001-4b28-b30a-d04af8196c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:29.167846 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 979/1949] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:28 2022] DELETE /identity/v3/users/1b51714670574bd2abae3e8560d44092 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:29.176102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d339e-2001-4b28-b30a-d04af8196c23 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:29.178005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd6b0-ba04-43de-9c89-90f0215d74eb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:29.178884 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd6b0-ba04-43de-9c89-90f0215d74eb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:29.179883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd6b0-ba04-43de-9c89-90f0215d74eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:29.219442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0d4fd6b0-ba04-43de-9c89-90f0215d74eb None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:29.219961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0d4fd6b0-ba04-43de-9c89-90f0215d74eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:29.280480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0fc64-cd34-4d23-b158-7f868c68b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:29.281581 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0fc64-cd34-4d23-b158-7f868c68b551 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:29.281965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0fc64-cd34-4d23-b158-7f868c68b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:29.282499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0fc64-cd34-4d23-b158-7f868c68b551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:29.283582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0fc64-cd34-4d23-b158-7f868c68b551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:29.286267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0fc64-cd34-4d23-b158-7f868c68b551 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:29.305892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 971/1950] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:29.310066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0fc64-cd34-4d23-b158-7f868c68b551 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:29.321114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0fc64-cd34-4d23-b158-7f868c68b551 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:29.326193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef982b5-dcae-417d-8fb3-9bd8b064e501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:29.326884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef982b5-dcae-417d-8fb3-9bd8b064e501 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:29.327228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef982b5-dcae-417d-8fb3-9bd8b064e501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:29.327596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef982b5-dcae-417d-8fb3-9bd8b064e501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:29.328628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef982b5-dcae-417d-8fb3-9bd8b064e501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:29.330051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef982b5-dcae-417d-8fb3-9bd8b064e501 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:29.335698 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 980/1951] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:29.345574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 972/1952] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:29.346039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fd6b0-ba04-43de-9c89-90f0215d74eb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:29.347366 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef982b5-dcae-417d-8fb3-9bd8b064e501 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:29.347870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0d4fd6b0-ba04-43de-9c89-90f0215d74eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:29.360902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef982b5-dcae-417d-8fb3-9bd8b064e501 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:29.367816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429473a-e226-4ed3-94f6-39f4ce63a29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:29.368590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429473a-e226-4ed3-94f6-39f4ce63a29a admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:29.368873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429473a-e226-4ed3-94f6-39f4ce63a29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:29.369148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429473a-e226-4ed3-94f6-39f4ce63a29a admin admin] PATH_INFO: `/v3/projects/6eb2d2e834a348ed8fce3dd96f957743/users/475f0d8fc4644ba88efd10e6168b8994/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:29.390034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429473a-e226-4ed3-94f6-39f4ce63a29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb2d2e834a348ed8fce3dd96f957743, user_id=475f0d8fc4644ba88efd10e6168b8994, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:29.393082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429473a-e226-4ed3-94f6-39f4ce63a29a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:29.436852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fd6b0-ba04-43de-9c89-90f0215d74eb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:29.438534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa9f2d-b1f6-4474-ac46-e1557c6d5688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:29.439265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9f2d-b1f6-4474-ac46-e1557c6d5688 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:29.439606 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9f2d-b1f6-4474-ac46-e1557c6d5688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:29.439942 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9f2d-b1f6-4474-ac46-e1557c6d5688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:29.449859 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa9f2d-b1f6-4474-ac46-e1557c6d5688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:29.451502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa9f2d-b1f6-4474-ac46-e1557c6d5688 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:29.466130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 981/1953] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:29.491525 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 973/1954] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:29 2022] PUT /identity/v3/projects/6eb2d2e834a348ed8fce3dd96f957743/users/475f0d8fc4644ba88efd10e6168b8994/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:29.503497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e3841-8fe2-440f-b0c4-1b14310d41e2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:29.503964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e3841-8fe2-440f-b0c4-1b14310d41e2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:29.504260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e3841-8fe2-440f-b0c4-1b14310d41e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:29.535189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-479e3841-8fe2-440f-b0c4-1b14310d41e2 None None] MFA Rules not processed for user `475f0d8fc4644ba88efd10e6168b8994`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:29.536845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-479e3841-8fe2-440f-b0c4-1b14310d41e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:29.614139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 982/1955] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:29.619215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429473a-e226-4ed3-94f6-39f4ce63a29a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:29.684714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429473a-e226-4ed3-94f6-39f4ce63a29a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:29.690483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e587282-5125-4463-b736-be73441dac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:29.691110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587282-5125-4463-b736-be73441dac0a admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:29.691392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587282-5125-4463-b736-be73441dac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:29.691666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587282-5125-4463-b736-be73441dac0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:29.692300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e587282-5125-4463-b736-be73441dac0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:29.694771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e587282-5125-4463-b736-be73441dac0a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:29.795432 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 974/1956] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:29 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:29.799380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e3841-8fe2-440f-b0c4-1b14310d41e2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:29.817772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e3841-8fe2-440f-b0c4-1b14310d41e2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:29.912511 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3d07-0654-4d16-8d2f-235a70a70183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:29.915206 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3d07-0654-4d16-8d2f-235a70a70183 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:29.915483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3d07-0654-4d16-8d2f-235a70a70183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:29.917109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3d07-0654-4d16-8d2f-235a70a70183 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:29.919252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3d07-0654-4d16-8d2f-235a70a70183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:29.924689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3d07-0654-4d16-8d2f-235a70a70183 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:30.073788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e587282-5125-4463-b736-be73441dac0a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:30.075253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 983/1957] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:29 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:30.078287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6e587282-5125-4463-b736-be73441dac0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:30.080585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3d07-0654-4d16-8d2f-235a70a70183 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:30.094868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e587282-5125-4463-b736-be73441dac0a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:30.100792 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:30.102253 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.102253 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.102447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] PATH_INFO: `/v3/projects/955ef703ee9c4b6393804c7255dc0192` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.102759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3d07-0654-4d16-8d2f-235a70a70183 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:30.103453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955ef703ee9c4b6393804c7255dc0192)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:30.105745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:30.109520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc280ad-963a-4451-ac52-10fafeda8642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:30.110480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc280ad-963a-4451-ac52-10fafeda8642 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.110831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc280ad-963a-4451-ac52-10fafeda8642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.111170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc280ad-963a-4451-ac52-10fafeda8642 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.114177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc280ad-963a-4451-ac52-10fafeda8642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:30.116350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc280ad-963a-4451-ac52-10fafeda8642 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:30.120672 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:30.136071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 984/1958] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:30.139782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc280ad-963a-4451-ac52-10fafeda8642 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:30.151560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc280ad-963a-4451-ac52-10fafeda8642 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:30.156325 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c8fbf-b430-417d-8943-9ef26930892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:30.157020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8fbf-b430-417d-8943-9ef26930892f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.157391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8fbf-b430-417d-8943-9ef26930892f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.157723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8fbf-b430-417d-8943-9ef26930892f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.158370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c8fbf-b430-417d-8943-9ef26930892f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:30.160017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c8fbf-b430-417d-8943-9ef26930892f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:30.172010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 985/1959] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:30.176344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c8fbf-b430-417d-8943-9ef26930892f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:30.187120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c8fbf-b430-417d-8943-9ef26930892f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:30.191786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee04b13-a6e1-438d-9722-71e2c762bfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:30.192423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee04b13-a6e1-438d-9722-71e2c762bfb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.192832 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee04b13-a6e1-438d-9722-71e2c762bfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.193109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee04b13-a6e1-438d-9722-71e2c762bfb5 admin admin] PATH_INFO: `/v3/projects/f0e6447e005441c89f72eef1b4e0cce8/users/e162e062a802465290cff14826e4f408/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.209560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee04b13-a6e1-438d-9722-71e2c762bfb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e6447e005441c89f72eef1b4e0cce8, user_id=e162e062a802465290cff14826e4f408, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:30.212596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee04b13-a6e1-438d-9722-71e2c762bfb5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:30.228393 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:30.364519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 986/1960] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:30 2022] PUT /identity/v3/projects/f0e6447e005441c89f72eef1b4e0cce8/users/e162e062a802465290cff14826e4f408/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:30.365601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee04b13-a6e1-438d-9722-71e2c762bfb5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:30.370918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fee04b13-a6e1-438d-9722-71e2c762bfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:30.372338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955ef703ee9c4b6393804c7255dc0192', 'request_id': 'req-1a611740-292e-43d5-af13-101d8b07d521'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:30.399315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955ef703ee9c4b6393804c7255dc0192', 'request_id': 'req-1a611740-292e-43d5-af13-101d8b07d521'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:30.439129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee04b13-a6e1-438d-9722-71e2c762bfb5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:30.486947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd5b6f-70e6-43f3-85bf-d610d68a06fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:30.487560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd5b6f-70e6-43f3-85bf-d610d68a06fc service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.487834 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd5b6f-70e6-43f3-85bf-d610d68a06fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.488100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd5b6f-70e6-43f3-85bf-d610d68a06fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.489870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d2bd5b6f-70e6-43f3-85bf-d610d68a06fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:30.524308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955ef703ee9c4b6393804c7255dc0192', 'request_id': 'req-1a611740-292e-43d5-af13-101d8b07d521'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:30.547350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] The token cache is being invalidate because project 955ef703ee9c4b6393804c7255dc0192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:30.547785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:30.548609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1a611740-292e-43d5-af13-101d8b07d521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:30.550252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 975/1961] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:30 2022] DELETE /identity/v3/projects/955ef703ee9c4b6393804c7255dc0192 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:30.551534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e986722-ea56-47ce-8f3d-99b6c09c8949 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.551935 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e986722-ea56-47ce-8f3d-99b6c09c8949 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.552316 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e986722-ea56-47ce-8f3d-99b6c09c8949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.552589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd5b6f-70e6-43f3-85bf-d610d68a06fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:30.554617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd5b6f-70e6-43f3-85bf-d610d68a06fc service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:30.564601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 987/1962] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:30.565870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f94d45-4e50-458f-a572-e8c054086d29 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.566222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f94d45-4e50-458f-a572-e8c054086d29 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.566559 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f94d45-4e50-458f-a572-e8c054086d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.584039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3e986722-ea56-47ce-8f3d-99b6c09c8949 None None] MFA Rules not processed for user `e162e062a802465290cff14826e4f408`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:30.585931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3e986722-ea56-47ce-8f3d-99b6c09c8949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:30.596275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-31f94d45-4e50-458f-a572-e8c054086d29 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:30.598928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-31f94d45-4e50-458f-a572-e8c054086d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:30.671367 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 976/1963] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:30.675966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e986722-ea56-47ce-8f3d-99b6c09c8949 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:30.677467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3e986722-ea56-47ce-8f3d-99b6c09c8949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:30.678248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 988/1964] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:30.686798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888261d6-7b48-4263-92cd-07ec8405dded None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.687208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888261d6-7b48-4263-92cd-07ec8405dded None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.687487 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888261d6-7b48-4263-92cd-07ec8405dded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.701876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e986722-ea56-47ce-8f3d-99b6c09c8949 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:30.707823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3819c2-4e21-4465-8a62-ac56df13aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:30.708628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3819c2-4e21-4465-8a62-ac56df13aa2a admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.709000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3819c2-4e21-4465-8a62-ac56df13aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.709444 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3819c2-4e21-4465-8a62-ac56df13aa2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.710933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3819c2-4e21-4465-8a62-ac56df13aa2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:30.714008 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3819c2-4e21-4465-8a62-ac56df13aa2a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:30.721351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-888261d6-7b48-4263-92cd-07ec8405dded None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:30.722676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-888261d6-7b48-4263-92cd-07ec8405dded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:30.732299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 989/1965] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:30.737077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888261d6-7b48-4263-92cd-07ec8405dded None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:30.746672 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888261d6-7b48-4263-92cd-07ec8405dded None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:30.751655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46779533-6f7c-4556-bb14-aa4fc0e19c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:30.752318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779533-6f7c-4556-bb14-aa4fc0e19c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.752787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779533-6f7c-4556-bb14-aa4fc0e19c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.753264 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779533-6f7c-4556-bb14-aa4fc0e19c43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.754149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46779533-6f7c-4556-bb14-aa4fc0e19c43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:30.754519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46779533-6f7c-4556-bb14-aa4fc0e19c43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:30.756162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46779533-6f7c-4556-bb14-aa4fc0e19c43 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:30.768499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 990/1966] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:30.774121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46779533-6f7c-4556-bb14-aa4fc0e19c43 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:30.783855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46779533-6f7c-4556-bb14-aa4fc0e19c43 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:30.790008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2531d93-09ad-44cd-8273-14aa0e8612f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:30.790681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531d93-09ad-44cd-8273-14aa0e8612f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.791233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531d93-09ad-44cd-8273-14aa0e8612f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.791233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531d93-09ad-44cd-8273-14aa0e8612f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.791847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2531d93-09ad-44cd-8273-14aa0e8612f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:30.793846 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2531d93-09ad-44cd-8273-14aa0e8612f8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:30.801476 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 977/1967] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:30 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:30.806178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3819c2-4e21-4465-8a62-ac56df13aa2a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:30.873872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3819c2-4e21-4465-8a62-ac56df13aa2a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:30.879920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de2fc8-4582-4e7d-a42f-ec69b2eaa32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:30.880540 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2fc8-4582-4e7d-a42f-ec69b2eaa32c admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.880844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2fc8-4582-4e7d-a42f-ec69b2eaa32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.881113 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2fc8-4582-4e7d-a42f-ec69b2eaa32c admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.881913 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de2fc8-4582-4e7d-a42f-ec69b2eaa32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:30.890439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de2fc8-4582-4e7d-a42f-ec69b2eaa32c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:30.916731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 991/1968] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:30 2022] POST /identity/v3/projects => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:30.920527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2531d93-09ad-44cd-8273-14aa0e8612f8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:30.970436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 978/1969] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:30 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:30.974140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de2fc8-4582-4e7d-a42f-ec69b2eaa32c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:30.985672 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2531d93-09ad-44cd-8273-14aa0e8612f8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:30.985842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de2fc8-4582-4e7d-a42f-ec69b2eaa32c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:30.990328 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e1f05-d018-45c2-af0a-f9ed600a359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:30.990505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498fe3c-55b8-431b-a2c6-cc294866a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:30.991500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e1f05-d018-45c2-af0a-f9ed600a359a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.991668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498fe3c-55b8-431b-a2c6-cc294866a45d admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:30.991812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e1f05-d018-45c2-af0a-f9ed600a359a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.991979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498fe3c-55b8-431b-a2c6-cc294866a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:30.992135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e1f05-d018-45c2-af0a-f9ed600a359a admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.992252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498fe3c-55b8-431b-a2c6-cc294866a45d admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:30.992637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e1f05-d018-45c2-af0a-f9ed600a359a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:30.992945 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498fe3c-55b8-431b-a2c6-cc294866a45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:30.994591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e1f05-d018-45c2-af0a-f9ed600a359a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:30.994731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498fe3c-55b8-431b-a2c6-cc294866a45d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:31.009507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 979/1970] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:31.012821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498fe3c-55b8-431b-a2c6-cc294866a45d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:31.023845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498fe3c-55b8-431b-a2c6-cc294866a45d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:31.029075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0790b-5239-42a3-a6ae-a21f1bd01ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:31.030898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0790b-5239-42a3-a6ae-a21f1bd01ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.030898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0790b-5239-42a3-a6ae-a21f1bd01ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.030898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0790b-5239-42a3-a6ae-a21f1bd01ba3 admin admin] PATH_INFO: `/v3/projects/b422a6c7973d4117bcf2cc60196b16e5/users/2f80942a13ed4a6caa479caa00cee5f5/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.047558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0790b-5239-42a3-a6ae-a21f1bd01ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b422a6c7973d4117bcf2cc60196b16e5, user_id=2f80942a13ed4a6caa479caa00cee5f5, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:31.050698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0790b-5239-42a3-a6ae-a21f1bd01ba3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:31.076044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 992/1971] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:30 2022] POST /identity/v3/users => generated 281 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:31.081170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e1f05-d018-45c2-af0a-f9ed600a359a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:31.103736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e1f05-d018-45c2-af0a-f9ed600a359a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:31.109135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1289b16-8350-4c35-89da-44e4e82e798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:31.112876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289b16-8350-4c35-89da-44e4e82e798f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.112876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289b16-8350-4c35-89da-44e4e82e798f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.112876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289b16-8350-4c35-89da-44e4e82e798f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.112876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1289b16-8350-4c35-89da-44e4e82e798f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:31.112876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1289b16-8350-4c35-89da-44e4e82e798f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:31.128359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 993/1972] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:31.129596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1289b16-8350-4c35-89da-44e4e82e798f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:31.140700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 980/1973] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:31 2022] PUT /identity/v3/projects/b422a6c7973d4117bcf2cc60196b16e5/users/2f80942a13ed4a6caa479caa00cee5f5/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:31.141794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1289b16-8350-4c35-89da-44e4e82e798f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:31.142310 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0790b-5239-42a3-a6ae-a21f1bd01ba3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:31.212814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff30f-bf4e-4696-85fd-4232313a7a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:31.213550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff30f-bf4e-4696-85fd-4232313a7a68 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.213938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff30f-bf4e-4696-85fd-4232313a7a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.214314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff30f-bf4e-4696-85fd-4232313a7a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.215078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcff30f-bf4e-4696-85fd-4232313a7a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:31.216929 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcff30f-bf4e-4696-85fd-4232313a7a68 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:31.232918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 994/1974] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:31.234091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff30f-bf4e-4696-85fd-4232313a7a68 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:31.250371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff30f-bf4e-4696-85fd-4232313a7a68 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:31.251928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1ed25-271d-4766-bd7b-0d24db1a568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:31.259879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ed25-271d-4766-bd7b-0d24db1a568e admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.259879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ed25-271d-4766-bd7b-0d24db1a568e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.259879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ed25-271d-4766-bd7b-0d24db1a568e admin admin] PATH_INFO: `/v3/projects/0acf7be6f08543a6a0014fc5efff45e4/users/d2f51705a2a94866802952ceee0d1e6f/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.260420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0790b-5239-42a3-a6ae-a21f1bd01ba3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:31.266554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7fbfe-1499-4151-bbf4-4ed3b39f5321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:31.267780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7fbfe-1499-4151-bbf4-4ed3b39f5321 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.268057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7fbfe-1499-4151-bbf4-4ed3b39f5321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.268324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7fbfe-1499-4151-bbf4-4ed3b39f5321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.269005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7fbfe-1499-4151-bbf4-4ed3b39f5321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:31.271140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7fbfe-1499-4151-bbf4-4ed3b39f5321 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:31.282549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1ed25-271d-4766-bd7b-0d24db1a568e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acf7be6f08543a6a0014fc5efff45e4, user_id=d2f51705a2a94866802952ceee0d1e6f, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:31.284046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 981/1975] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:31.286363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1ed25-271d-4766-bd7b-0d24db1a568e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:31.288986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7fbfe-1499-4151-bbf4-4ed3b39f5321 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:31.300754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7fbfe-1499-4151-bbf4-4ed3b39f5321 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:31.306612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69b727-148b-457a-b0bf-6bf58515551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:31.307598 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69b727-148b-457a-b0bf-6bf58515551c admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.308085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69b727-148b-457a-b0bf-6bf58515551c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.308453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69b727-148b-457a-b0bf-6bf58515551c admin admin] PATH_INFO: `/v3/projects/b422a6c7973d4117bcf2cc60196b16e5/users/2f80942a13ed4a6caa479caa00cee5f5/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.310505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69b727-148b-457a-b0bf-6bf58515551c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b422a6c7973d4117bcf2cc60196b16e5, user_id=2f80942a13ed4a6caa479caa00cee5f5, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:31.313540 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69b727-148b-457a-b0bf-6bf58515551c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:31.325860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 982/1976] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:31 2022] PUT /identity/v3/projects/b422a6c7973d4117bcf2cc60196b16e5/users/2f80942a13ed4a6caa479caa00cee5f5/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:31.337061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15502e10-a6a5-4076-9c93-b467e038946c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.337353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15502e10-a6a5-4076-9c93-b467e038946c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.337688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15502e10-a6a5-4076-9c93-b467e038946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.364979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 995/1977] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:31 2022] PUT /identity/v3/projects/0acf7be6f08543a6a0014fc5efff45e4/users/d2f51705a2a94866802952ceee0d1e6f/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:31.370383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-15502e10-a6a5-4076-9c93-b467e038946c None None] MFA Rules not processed for user `2f80942a13ed4a6caa479caa00cee5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:31.371286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-15502e10-a6a5-4076-9c93-b467e038946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:31.376266 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c8555-b76a-4bc3-a0a2-0a2e5d3aa7e1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.377590 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c8555-b76a-4bc3-a0a2-0a2e5d3aa7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.378023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c8555-b76a-4bc3-a0a2-0a2e5d3aa7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.409181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a19c8555-b76a-4bc3-a0a2-0a2e5d3aa7e1 None None] MFA Rules not processed for user `d2f51705a2a94866802952ceee0d1e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:31.411063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a19c8555-b76a-4bc3-a0a2-0a2e5d3aa7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:31.467592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 983/1978] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:31.481508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15502e10-a6a5-4076-9c93-b467e038946c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:31.483060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-15502e10-a6a5-4076-9c93-b467e038946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:31.537942 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 996/1979] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:31.565468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:31.568550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15502e10-a6a5-4076-9c93-b467e038946c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:31.573863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bace51-9eb2-4a0e-b9d0-11a56656db24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:31.576431 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bace51-9eb2-4a0e-b9d0-11a56656db24 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.576431 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bace51-9eb2-4a0e-b9d0-11a56656db24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.576431 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bace51-9eb2-4a0e-b9d0-11a56656db24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.589894 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:31.592617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bace51-9eb2-4a0e-b9d0-11a56656db24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:31.593462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c8555-b76a-4bc3-a0a2-0a2e5d3aa7e1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:31.594573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bace51-9eb2-4a0e-b9d0-11a56656db24 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:31.595345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a19c8555-b76a-4bc3-a0a2-0a2e5d3aa7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:31.609063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 984/1980] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:31.612426 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c8555-b76a-4bc3-a0a2-0a2e5d3aa7e1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:31.617908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36577735-c607-46bc-a7b0-1cdca096b0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:31.623107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36577735-c607-46bc-a7b0-1cdca096b0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.623107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36577735-c607-46bc-a7b0-1cdca096b0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.623107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36577735-c607-46bc-a7b0-1cdca096b0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.633142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36577735-c607-46bc-a7b0-1cdca096b0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:31.635646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36577735-c607-46bc-a7b0-1cdca096b0d3 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:31.645706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 997/1981] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:31.668482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bace51-9eb2-4a0e-b9d0-11a56656db24 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:31.711838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36577735-c607-46bc-a7b0-1cdca096b0d3 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:31.722382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36577735-c607-46bc-a7b0-1cdca096b0d3 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:31.727146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5ac1a-effc-4161-9813-124b8565287c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:31.727772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5ac1a-effc-4161-9813-124b8565287c service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.729483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5ac1a-effc-4161-9813-124b8565287c service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.729788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5ac1a-effc-4161-9813-124b8565287c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.732572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c3f5ac1a-effc-4161-9813-124b8565287c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:31.816281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bace51-9eb2-4a0e-b9d0-11a56656db24 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:31.822231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:31.822886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:31.823165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:31.823443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] PATH_INFO: `/v3/users/d2f51705a2a94866802952ceee0d1e6f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:31.825356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f51705a2a94866802952ceee0d1e6f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:31.827457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:31.854414 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5ac1a-effc-4161-9813-124b8565287c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:31.855962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5ac1a-effc-4161-9813-124b8565287c service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:31.871939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 998/1982] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:32.076830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f51705a2a94866802952ceee0d1e6f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:32.077856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f51705a2a94866802952ceee0d1e6f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:32.089315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f51705a2a94866802952ceee0d1e6f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:32.105659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f51705a2a94866802952ceee0d1e6f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:32.170348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f51705a2a94866802952ceee0d1e6f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:32.179496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 985/1983] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:31 2022] DELETE /identity/v3/users/d2f51705a2a94866802952ceee0d1e6f => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:32.184547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc19ef-c2ff-45de-9270-fcc4fe0f62be None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:32.185055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc19ef-c2ff-45de-9270-fcc4fe0f62be None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:32.185442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc19ef-c2ff-45de-9270-fcc4fe0f62be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:32.207673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-74cc19ef-c2ff-45de-9270-fcc4fe0f62be None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:32.208958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-74cc19ef-c2ff-45de-9270-fcc4fe0f62be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:32.274470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 999/1984] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:32.301181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:32.304225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:32.378602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6153b-9ebe-40ed-b753-e83310cdc2eb admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:32.384090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e1473-cef7-46eb-8d04-e068adec26d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:32.384712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e1473-cef7-46eb-8d04-e068adec26d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:32.385051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e1473-cef7-46eb-8d04-e068adec26d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:32.385304 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e1473-cef7-46eb-8d04-e068adec26d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:32.395228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e1473-cef7-46eb-8d04-e068adec26d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:32.397342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e1473-cef7-46eb-8d04-e068adec26d8 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:32.407765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 986/1985] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:32.908933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:32.994214 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:33.378538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc19ef-c2ff-45de-9270-fcc4fe0f62be None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:33.380139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-74cc19ef-c2ff-45de-9270-fcc4fe0f62be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:33.406885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc19ef-c2ff-45de-9270-fcc4fe0f62be None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:33.413240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:33.413964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:33.414241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:33.414508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] PATH_INFO: `/v3/projects/0acf7be6f08543a6a0014fc5efff45e4` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:33.417179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acf7be6f08543a6a0014fc5efff45e4)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:33.419207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:33.571925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acf7be6f08543a6a0014fc5efff45e4', 'request_id': 'req-df7eabd2-125b-4b52-bfa9-c2b4ba150580'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:33.586782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acf7be6f08543a6a0014fc5efff45e4', 'request_id': 'req-df7eabd2-125b-4b52-bfa9-c2b4ba150580'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:33.600985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acf7be6f08543a6a0014fc5efff45e4', 'request_id': 'req-df7eabd2-125b-4b52-bfa9-c2b4ba150580'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:33.673254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] The token cache is being invalidate because project 0acf7be6f08543a6a0014fc5efff45e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:33.673663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:33.674428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df7eabd2-125b-4b52-bfa9-c2b4ba150580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:33.676362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1000/1986] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:33 2022] DELETE /identity/v3/projects/0acf7be6f08543a6a0014fc5efff45e4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:33.681804 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6547b-1740-48e8-acce-4a359b496c7c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:33.682089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6547b-1740-48e8-acce-4a359b496c7c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:33.682636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6547b-1740-48e8-acce-4a359b496c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:33.718665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4bf6547b-1740-48e8-acce-4a359b496c7c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:33.720254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4bf6547b-1740-48e8-acce-4a359b496c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:33.790789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 987/1987] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:33.799876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68bc9e-2ad8-44b5-9e3f-a2e14212ffe2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:33.800159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68bc9e-2ad8-44b5-9e3f-a2e14212ffe2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:33.800433 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68bc9e-2ad8-44b5-9e3f-a2e14212ffe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:33.849608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ba68bc9e-2ad8-44b5-9e3f-a2e14212ffe2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:33.855894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ba68bc9e-2ad8-44b5-9e3f-a2e14212ffe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:33.882568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1001/1988] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:33.883461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6547b-1740-48e8-acce-4a359b496c7c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:33.898860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6547b-1740-48e8-acce-4a359b496c7c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:33.922401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecb2a5-6902-496a-a4c1-e8a5944a3c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:33.922401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecb2a5-6902-496a-a4c1-e8a5944a3c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:33.922401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecb2a5-6902-496a-a4c1-e8a5944a3c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:33.922401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecb2a5-6902-496a-a4c1-e8a5944a3c81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:33.922717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecb2a5-6902-496a-a4c1-e8a5944a3c81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:33.922717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecb2a5-6902-496a-a4c1-e8a5944a3c81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:33.922717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecb2a5-6902-496a-a4c1-e8a5944a3c81 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:33.955908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 988/1989] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:24:33.960887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68bc9e-2ad8-44b5-9e3f-a2e14212ffe2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:33.983553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68bc9e-2ad8-44b5-9e3f-a2e14212ffe2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:34.003603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc416e0-16ec-4e4f-83d0-13904f235f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:34.012458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc416e0-16ec-4e4f-83d0-13904f235f40 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:34.013184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc416e0-16ec-4e4f-83d0-13904f235f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:34.013630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc416e0-16ec-4e4f-83d0-13904f235f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:34.015240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc416e0-16ec-4e4f-83d0-13904f235f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:34.019567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc416e0-16ec-4e4f-83d0-13904f235f40 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:34.144091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1002/1990] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:33 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:34.148770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecb2a5-6902-496a-a4c1-e8a5944a3c81 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:34.165534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecb2a5-6902-496a-a4c1-e8a5944a3c81 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:34.168501 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:34.266761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389525bb-f681-4c3b-9f82-a2aecd0c94a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:34.266761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389525bb-f681-4c3b-9f82-a2aecd0c94a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:34.266761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389525bb-f681-4c3b-9f82-a2aecd0c94a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:34.266761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389525bb-f681-4c3b-9f82-a2aecd0c94a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:34.267087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389525bb-f681-4c3b-9f82-a2aecd0c94a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:34.268571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389525bb-f681-4c3b-9f82-a2aecd0c94a8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:34.411402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 989/1991] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:34 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:34.417149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc416e0-16ec-4e4f-83d0-13904f235f40 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:34.434827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc416e0-16ec-4e4f-83d0-13904f235f40 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:34.448511 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1241bbc-f717-4afa-929d-cbbc8a9d7cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:34.449146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1241bbc-f717-4afa-929d-cbbc8a9d7cbd admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:34.449464 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1241bbc-f717-4afa-929d-cbbc8a9d7cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:34.449740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1241bbc-f717-4afa-929d-cbbc8a9d7cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:34.450391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1241bbc-f717-4afa-929d-cbbc8a9d7cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:34.452232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1241bbc-f717-4afa-929d-cbbc8a9d7cbd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:34.470398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1003/1992] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:34.474995 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389525bb-f681-4c3b-9f82-a2aecd0c94a8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:34.485951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389525bb-f681-4c3b-9f82-a2aecd0c94a8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:34.491612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21829fe-9f00-464d-9a98-bdee0e82b7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:34.492264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21829fe-9f00-464d-9a98-bdee0e82b7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:34.493157 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21829fe-9f00-464d-9a98-bdee0e82b7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:34.493478 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21829fe-9f00-464d-9a98-bdee0e82b7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:34.494142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21829fe-9f00-464d-9a98-bdee0e82b7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:34.496011 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21829fe-9f00-464d-9a98-bdee0e82b7c2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:34.511750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 990/1993] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:34.514850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1241bbc-f717-4afa-929d-cbbc8a9d7cbd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:34.525863 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1241bbc-f717-4afa-929d-cbbc8a9d7cbd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:34.535493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:34.544164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc629b8-593c-43eb-8046-60d74315a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:34.545062 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc629b8-593c-43eb-8046-60d74315a442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:34.545600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc629b8-593c-43eb-8046-60d74315a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:34.546055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc629b8-593c-43eb-8046-60d74315a442 admin admin] PATH_INFO: `/v3/projects/99f64de71592440aa7ff5e6ef9c9d029/users/2d6824f1fc51455db311d2609f303d27/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:34.574171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc629b8-593c-43eb-8046-60d74315a442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f64de71592440aa7ff5e6ef9c9d029, user_id=2d6824f1fc51455db311d2609f303d27, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:34.576952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc629b8-593c-43eb-8046-60d74315a442 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:34.682568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1004/1994] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:34 2022] PUT /identity/v3/projects/99f64de71592440aa7ff5e6ef9c9d029/users/2d6824f1fc51455db311d2609f303d27/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:34.700268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647c00-9fad-4bcd-a8f2-138733f04a71 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:34.700268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647c00-9fad-4bcd-a8f2-138733f04a71 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:34.700268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647c00-9fad-4bcd-a8f2-138733f04a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:34.741048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-18647c00-9fad-4bcd-a8f2-138733f04a71 None None] MFA Rules not processed for user `2d6824f1fc51455db311d2609f303d27`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:34.742511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-18647c00-9fad-4bcd-a8f2-138733f04a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:34.823357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 991/1995] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:34.890680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc629b8-593c-43eb-8046-60d74315a442 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:34.892502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ebc629b8-593c-43eb-8046-60d74315a442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:34.958018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc629b8-593c-43eb-8046-60d74315a442 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:34.962193 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b037f49-0bfc-4603-911d-a5ef424ecf75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:34.962882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b037f49-0bfc-4603-911d-a5ef424ecf75 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:34.963210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b037f49-0bfc-4603-911d-a5ef424ecf75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:34.965796 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b037f49-0bfc-4603-911d-a5ef424ecf75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:34.972400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b037f49-0bfc-4603-911d-a5ef424ecf75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:34.974040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b037f49-0bfc-4603-911d-a5ef424ecf75 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:34.988681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1005/1996] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:35.512851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:35.684328 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:36.204896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:36.347008 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:36.500071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18647c00-9fad-4bcd-a8f2-138733f04a71 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:36.501579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-18647c00-9fad-4bcd-a8f2-138733f04a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:36.567429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18647c00-9fad-4bcd-a8f2-138733f04a71 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:36.572612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:36.573244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:36.573559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:36.573830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] PATH_INFO: `/v3/users/a6d7132b64884e36aa0be6dc310d5912` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:36.574957 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d7132b64884e36aa0be6dc310d5912)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:36.576885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:36.604072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:36.769857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d7132b64884e36aa0be6dc310d5912'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:36.770707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d7132b64884e36aa0be6dc310d5912'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:36.780491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d7132b64884e36aa0be6dc310d5912'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:36.795731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d7132b64884e36aa0be6dc310d5912'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:36.855497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d7132b64884e36aa0be6dc310d5912'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:36.866918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 992/1997] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:36 2022] DELETE /identity/v3/users/a6d7132b64884e36aa0be6dc310d5912 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:36.869907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f121b-ceb2-4a4e-9a92-4a1ee272bc5a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:36.870339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f121b-ceb2-4a4e-9a92-4a1ee272bc5a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:36.870437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f121b-ceb2-4a4e-9a92-4a1ee272bc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:36.898092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-824f121b-ceb2-4a4e-9a92-4a1ee272bc5a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:36.898092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-824f121b-ceb2-4a4e-9a92-4a1ee272bc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:36.903045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:36.905108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:36.965812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1006/1998] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:36.966816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:36.983507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f121b-ceb2-4a4e-9a92-4a1ee272bc5a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:36.985009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-824f121b-ceb2-4a4e-9a92-4a1ee272bc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:36.994924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e628e95-d1b5-44cd-8ec7-46d8794a1c3f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:37.000692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:37.001866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:37.002325 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:37.003072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] PATH_INFO: `/v3/users/475f0d8fc4644ba88efd10e6168b8994` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:37.004239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] RBAC: Authorizing `identity:delete_user(user_id=475f0d8fc4644ba88efd10e6168b8994)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:37.007315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:37.057031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f121b-ceb2-4a4e-9a92-4a1ee272bc5a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:37.061123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93e498-53d9-43fa-85c1-b3409ec938e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:37.061765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93e498-53d9-43fa-85c1-b3409ec938e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:37.062043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93e498-53d9-43fa-85c1-b3409ec938e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:37.062311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93e498-53d9-43fa-85c1-b3409ec938e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:37.071867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93e498-53d9-43fa-85c1-b3409ec938e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:37.073324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93e498-53d9-43fa-85c1-b3409ec938e9 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:37.082901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1007/1999] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:37.230596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '475f0d8fc4644ba88efd10e6168b8994'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:37.230596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '475f0d8fc4644ba88efd10e6168b8994'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:37.237245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '475f0d8fc4644ba88efd10e6168b8994'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:37.249638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '475f0d8fc4644ba88efd10e6168b8994'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:37.682589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '475f0d8fc4644ba88efd10e6168b8994'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:37.690317 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 993/2000] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:36 2022] DELETE /identity/v3/users/475f0d8fc4644ba88efd10e6168b8994 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:37.694999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616cc77-1ff1-4017-bc76-e1d4327e7958 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:37.695316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616cc77-1ff1-4017-bc76-e1d4327e7958 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:37.695596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616cc77-1ff1-4017-bc76-e1d4327e7958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:37.718541 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4616cc77-1ff1-4017-bc76-e1d4327e7958 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:37.719751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4616cc77-1ff1-4017-bc76-e1d4327e7958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:37.780784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1008/2001] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:37.792172 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:37.793707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:37.850831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b0c43-6e06-4ed1-a98b-73529f9c888a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:37.854462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05c34b-67e0-4dbb-9546-a53b7e494e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:37.855068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05c34b-67e0-4dbb-9546-a53b7e494e0b service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:37.855345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05c34b-67e0-4dbb-9546-a53b7e494e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:37.855612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05c34b-67e0-4dbb-9546-a53b7e494e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:37.864899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05c34b-67e0-4dbb-9546-a53b7e494e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:37.866500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05c34b-67e0-4dbb-9546-a53b7e494e0b service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:37.876438 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 994/2002] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:38.449393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616cc77-1ff1-4017-bc76-e1d4327e7958 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:38.451714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4616cc77-1ff1-4017-bc76-e1d4327e7958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:38.473355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616cc77-1ff1-4017-bc76-e1d4327e7958 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:38.478819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:38.479557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:38.479904 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:38.480245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] PATH_INFO: `/v3/projects/95840ee759c44abbbd45f254078cc33f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:38.482722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95840ee759c44abbbd45f254078cc33f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:38.486554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:38.884305 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:38.914615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95840ee759c44abbbd45f254078cc33f', 'request_id': 'req-70f5f2f1-644d-4ebd-b642-1c057f542284'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:38.924965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95840ee759c44abbbd45f254078cc33f', 'request_id': 'req-70f5f2f1-644d-4ebd-b642-1c057f542284'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:38.935654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95840ee759c44abbbd45f254078cc33f', 'request_id': 'req-70f5f2f1-644d-4ebd-b642-1c057f542284'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.043069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] The token cache is being invalidate because project 95840ee759c44abbbd45f254078cc33f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:39.048593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.048593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.048593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1009/2003] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:38 2022] DELETE /identity/v3/projects/95840ee759c44abbbd45f254078cc33f => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:39.051297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05c34b-67e0-4dbb-9546-a53b7e494e0b service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:39.069474 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05c34b-67e0-4dbb-9546-a53b7e494e0b service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:39.180488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:39.181322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:39.181832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:39.182657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] PATH_INFO: `/v3/users/01dde55b1cf0426aab50d52e968b2e1d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:39.183974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01dde55b1cf0426aab50d52e968b2e1d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:39.187861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:39.316406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:39.319456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:39.344329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5f2f1-644d-4ebd-b642-1c057f542284 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:39.349842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:39.350493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:39.350775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:39.351071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] PATH_INFO: `/v3/projects/6eb2d2e834a348ed8fce3dd96f957743` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:39.353075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb2d2e834a348ed8fce3dd96f957743)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:39.355184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:39.411032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:39.423851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01dde55b1cf0426aab50d52e968b2e1d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.424592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01dde55b1cf0426aab50d52e968b2e1d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.431793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01dde55b1cf0426aab50d52e968b2e1d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.443815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01dde55b1cf0426aab50d52e968b2e1d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.449495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb2d2e834a348ed8fce3dd96f957743', 'request_id': 'req-5249b692-7a33-4228-8da0-a7b14d007f1e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.455243 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb2d2e834a348ed8fce3dd96f957743', 'request_id': 'req-5249b692-7a33-4228-8da0-a7b14d007f1e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.462335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb2d2e834a348ed8fce3dd96f957743', 'request_id': 'req-5249b692-7a33-4228-8da0-a7b14d007f1e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.546005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01dde55b1cf0426aab50d52e968b2e1d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.552537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 995/2004] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:39 2022] DELETE /identity/v3/users/01dde55b1cf0426aab50d52e968b2e1d => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:39.654570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] The token cache is being invalidate because project 6eb2d2e834a348ed8fce3dd96f957743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:39.658027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.658027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.658027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1010/2005] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:39 2022] DELETE /identity/v3/projects/6eb2d2e834a348ed8fce3dd96f957743 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:39.661449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:39.662829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:39.727560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5220093-e196-4558-bc06-672b51f78da2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:39.732348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b3d68-6be5-47bd-97e4-7633d44cb571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:39.733406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3d68-6be5-47bd-97e4-7633d44cb571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:39.737591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3d68-6be5-47bd-97e4-7633d44cb571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:39.738169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3d68-6be5-47bd-97e4-7633d44cb571 admin admin] PATH_INFO: `/v3/users/e162e062a802465290cff14826e4f408` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:39.739917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b3d68-6be5-47bd-97e4-7633d44cb571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e162e062a802465290cff14826e4f408)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:39.743055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b3d68-6be5-47bd-97e4-7633d44cb571 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:39.995022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f96b3d68-6be5-47bd-97e4-7633d44cb571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e162e062a802465290cff14826e4f408'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:39.995683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f96b3d68-6be5-47bd-97e4-7633d44cb571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e162e062a802465290cff14826e4f408'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.003092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f96b3d68-6be5-47bd-97e4-7633d44cb571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e162e062a802465290cff14826e4f408'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.004852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:40.006668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:40.016743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f96b3d68-6be5-47bd-97e4-7633d44cb571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e162e062a802465290cff14826e4f408'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.060335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:40.080632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249b692-7a33-4228-8da0-a7b14d007f1e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:40.086133 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:40.086810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:40.087092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:40.087367 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] PATH_INFO: `/v3/projects/b9311aa871db48d69311faba925e19b0` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:40.088498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9311aa871db48d69311faba925e19b0)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:40.090540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:40.093890 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f96b3d68-6be5-47bd-97e4-7633d44cb571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e162e062a802465290cff14826e4f408'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.103103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:40.104757 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 996/2006] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:39 2022] DELETE /identity/v3/users/e162e062a802465290cff14826e4f408 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:40.222433 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9311aa871db48d69311faba925e19b0', 'request_id': 'req-dad4b000-a4f1-4ec2-9088-d74d14492d65'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.233268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9311aa871db48d69311faba925e19b0', 'request_id': 'req-dad4b000-a4f1-4ec2-9088-d74d14492d65'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.234376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9311aa871db48d69311faba925e19b0', 'request_id': 'req-dad4b000-a4f1-4ec2-9088-d74d14492d65'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.340712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] The token cache is being invalidate because project b9311aa871db48d69311faba925e19b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:40.341504 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.342330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dad4b000-a4f1-4ec2-9088-d74d14492d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.347290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1011/2007] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:40 2022] DELETE /identity/v3/projects/b9311aa871db48d69311faba925e19b0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:40.349528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254f26-7397-4e73-b873-21f78e96b9c5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:40.349813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254f26-7397-4e73-b873-21f78e96b9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:40.350137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254f26-7397-4e73-b873-21f78e96b9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:40.374539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-24254f26-7397-4e73-b873-21f78e96b9c5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:40.376051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-24254f26-7397-4e73-b873-21f78e96b9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:40.457277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 997/2008] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:40.459327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f83319-e0db-4d7d-978d-3face414e6df None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:40.459781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f83319-e0db-4d7d-978d-3face414e6df None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:40.459888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f83319-e0db-4d7d-978d-3face414e6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:40.480979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e4f83319-e0db-4d7d-978d-3face414e6df None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:40.482212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e4f83319-e0db-4d7d-978d-3face414e6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:40.489979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1012/2009] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:40.494463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24254f26-7397-4e73-b873-21f78e96b9c5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:40.495022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:40.503923 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24254f26-7397-4e73-b873-21f78e96b9c5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:40.509122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c5784-1f20-4051-a292-2ff0528da5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:40.513237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5784-1f20-4051-a292-2ff0528da5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:40.513237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5784-1f20-4051-a292-2ff0528da5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:40.513237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5784-1f20-4051-a292-2ff0528da5e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:40.513237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c5784-1f20-4051-a292-2ff0528da5e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:40.513237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c5784-1f20-4051-a292-2ff0528da5e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:40.513237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c5784-1f20-4051-a292-2ff0528da5e6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:40.524757 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 998/2010] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:40.528936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f83319-e0db-4d7d-978d-3face414e6df None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:40.538764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f83319-e0db-4d7d-978d-3face414e6df None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:40.542930 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c5784-1f20-4051-a292-2ff0528da5e6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:40.544887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913e0ec-9dfe-4202-a55d-dea46db4274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:40.545512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-427c5784-1f20-4051-a292-2ff0528da5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:40.545624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e0ec-9dfe-4202-a55d-dea46db4274a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:40.545825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e0ec-9dfe-4202-a55d-dea46db4274a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:40.546102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e0ec-9dfe-4202-a55d-dea46db4274a admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:40.546771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913e0ec-9dfe-4202-a55d-dea46db4274a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:40.548960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913e0ec-9dfe-4202-a55d-dea46db4274a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:40.563659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c5784-1f20-4051-a292-2ff0528da5e6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:40.570921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:40.571621 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:40.571973 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:40.572145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] PATH_INFO: `/v3/projects/f0e6447e005441c89f72eef1b4e0cce8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:40.573457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e6447e005441c89f72eef1b4e0cce8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:40.575958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:40.639945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1013/2011] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:40 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:40.644185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913e0ec-9dfe-4202-a55d-dea46db4274a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:40.692006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e6447e005441c89f72eef1b4e0cce8', 'request_id': 'req-11004a22-7f52-4053-944b-6e81fc065c0a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.699795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e6447e005441c89f72eef1b4e0cce8', 'request_id': 'req-11004a22-7f52-4053-944b-6e81fc065c0a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.706994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913e0ec-9dfe-4202-a55d-dea46db4274a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:40.761053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1849e3c-cc58-4716-b216-d118ee708b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:40.761625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849e3c-cc58-4716-b216-d118ee708b4a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:40.761899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849e3c-cc58-4716-b216-d118ee708b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:40.762163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849e3c-cc58-4716-b216-d118ee708b4a admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:40.762780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1849e3c-cc58-4716-b216-d118ee708b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:40.764673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1849e3c-cc58-4716-b216-d118ee708b4a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:40.802728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e6447e005441c89f72eef1b4e0cce8', 'request_id': 'req-11004a22-7f52-4053-944b-6e81fc065c0a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.820547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] The token cache is being invalidate because project f0e6447e005441c89f72eef1b4e0cce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:40.820984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.821927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:40.823493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 999/2012] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:40 2022] DELETE /identity/v3/projects/f0e6447e005441c89f72eef1b4e0cce8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:40.827397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:40.829342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:40.832105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1014/2013] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:40 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:40.836191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1849e3c-cc58-4716-b216-d118ee708b4a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:40.838027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b1849e3c-cc58-4716-b216-d118ee708b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:40.842987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11004a22-7f52-4053-944b-6e81fc065c0a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:40.847666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:40.848293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:40.848570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:40.848841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] PATH_INFO: `/v3/users/2f80942a13ed4a6caa479caa00cee5f5` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:40.849386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1849e3c-cc58-4716-b216-d118ee708b4a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:40.849987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f80942a13ed4a6caa479caa00cee5f5)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:40.851926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:40.854066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5700183-7527-4ed6-bf84-d222e500c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:40.858027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5700183-7527-4ed6-bf84-d222e500c97f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:40.858027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5700183-7527-4ed6-bf84-d222e500c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:40.858027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5700183-7527-4ed6-bf84-d222e500c97f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:40.858027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5700183-7527-4ed6-bf84-d222e500c97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:40.858027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5700183-7527-4ed6-bf84-d222e500c97f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:40.868138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1015/2014] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:40.872261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5700183-7527-4ed6-bf84-d222e500c97f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:40.881675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5700183-7527-4ed6-bf84-d222e500c97f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:40.886955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0160bfb-af92-4a57-a60b-b39d9aae11ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:40.889306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160bfb-af92-4a57-a60b-b39d9aae11ad admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:40.889306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160bfb-af92-4a57-a60b-b39d9aae11ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:40.889306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0160bfb-af92-4a57-a60b-b39d9aae11ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:40.889306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0160bfb-af92-4a57-a60b-b39d9aae11ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:40.890329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0160bfb-af92-4a57-a60b-b39d9aae11ad admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:40.901404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1016/2015] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:40.905402 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0160bfb-af92-4a57-a60b-b39d9aae11ad admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:40.916382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0160bfb-af92-4a57-a60b-b39d9aae11ad admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:40.920948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264c6be-6c8f-4365-a176-4482258a8eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:40.921623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264c6be-6c8f-4365-a176-4482258a8eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:40.921896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264c6be-6c8f-4365-a176-4482258a8eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:40.922181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264c6be-6c8f-4365-a176-4482258a8eb1 admin admin] PATH_INFO: `/v3/projects/6e22a71d1ebd45d5972563444e6e3ade/users/d885de521d6c40a2b411f23ac5235c23/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:40.937509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264c6be-6c8f-4365-a176-4482258a8eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e22a71d1ebd45d5972563444e6e3ade, user_id=d885de521d6c40a2b411f23ac5235c23, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:40.940178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264c6be-6c8f-4365-a176-4482258a8eb1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:41.061635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1017/2016] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:40 2022] PUT /identity/v3/projects/6e22a71d1ebd45d5972563444e6e3ade/users/d885de521d6c40a2b411f23ac5235c23/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:41.069311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f80942a13ed4a6caa479caa00cee5f5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.070093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f80942a13ed4a6caa479caa00cee5f5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.071947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea6eae-a8f0-4a73-a495-a4bf4c6a6f45 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:41.072234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea6eae-a8f0-4a73-a495-a4bf4c6a6f45 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:41.072508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea6eae-a8f0-4a73-a495-a4bf4c6a6f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:41.077217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f80942a13ed4a6caa479caa00cee5f5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.089288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f80942a13ed4a6caa479caa00cee5f5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.105558 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-54ea6eae-a8f0-4a73-a495-a4bf4c6a6f45 None None] MFA Rules not processed for user `d885de521d6c40a2b411f23ac5235c23`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:41.106780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-54ea6eae-a8f0-4a73-a495-a4bf4c6a6f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:41.145799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f80942a13ed4a6caa479caa00cee5f5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.153146 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1000/2017] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:40 2022] DELETE /identity/v3/users/2f80942a13ed4a6caa479caa00cee5f5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:41.175707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1018/2018] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:41.180850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:41.181416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:41.204028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea6eae-a8f0-4a73-a495-a4bf4c6a6f45 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:41.208900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-54ea6eae-a8f0-4a73-a495-a4bf4c6a6f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:41.302818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5bfdb-4e80-4555-b347-0ee125cbcff3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:41.308308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a02112-3922-4d4d-9db5-cd77cef4fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:41.308927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a02112-3922-4d4d-9db5-cd77cef4fda3 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:41.309210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a02112-3922-4d4d-9db5-cd77cef4fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:41.310045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a02112-3922-4d4d-9db5-cd77cef4fda3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:41.310760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a02112-3922-4d4d-9db5-cd77cef4fda3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:41.311873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea6eae-a8f0-4a73-a495-a4bf4c6a6f45 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:41.313229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a02112-3922-4d4d-9db5-cd77cef4fda3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:41.316993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:41.317675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:41.320430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:41.320430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] PATH_INFO: `/v3/users/2d6824f1fc51455db311d2609f303d27` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:41.320430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6824f1fc51455db311d2609f303d27)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:41.322285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:41.347382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:41.404714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1001/2019] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:41 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:41.405729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a02112-3922-4d4d-9db5-cd77cef4fda3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:41.482650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a02112-3922-4d4d-9db5-cd77cef4fda3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:41.488962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928bc3f-68a8-4afe-9363-0b8ab9a33ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:41.489753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928bc3f-68a8-4afe-9363-0b8ab9a33ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:41.490416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928bc3f-68a8-4afe-9363-0b8ab9a33ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:41.490416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928bc3f-68a8-4afe-9363-0b8ab9a33ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:41.490891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928bc3f-68a8-4afe-9363-0b8ab9a33ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:41.494533 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928bc3f-68a8-4afe-9363-0b8ab9a33ac2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:41.498789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:41.514705 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6824f1fc51455db311d2609f303d27'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.519328 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6824f1fc51455db311d2609f303d27'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.536184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6824f1fc51455db311d2609f303d27'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.544224 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6824f1fc51455db311d2609f303d27'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.545654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6824f1fc51455db311d2609f303d27'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.626898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1002/2020] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:41 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:41.630746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928bc3f-68a8-4afe-9363-0b8ab9a33ac2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:41.633116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1928bc3f-68a8-4afe-9363-0b8ab9a33ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:41.645584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928bc3f-68a8-4afe-9363-0b8ab9a33ac2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:41.651887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc2148-88a6-4862-a571-824c6ecd28e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:41.652909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2148-88a6-4862-a571-824c6ecd28e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:41.653244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2148-88a6-4862-a571-824c6ecd28e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:41.653620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2148-88a6-4862-a571-824c6ecd28e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:41.654329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc2148-88a6-4862-a571-824c6ecd28e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:41.657538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc2148-88a6-4862-a571-824c6ecd28e1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:41.664901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1019/2021] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:41 2022] DELETE /identity/v3/users/2d6824f1fc51455db311d2609f303d27 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:41.666211 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:41.668516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:41.675320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1003/2022] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:41.677587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7a58f-7675-4e9d-9869-ebc99153f248 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:41.678314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7a58f-7675-4e9d-9869-ebc99153f248 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:41.678787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7a58f-7675-4e9d-9869-ebc99153f248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:41.701908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-25e7a58f-7675-4e9d-9869-ebc99153f248 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:41.703151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-25e7a58f-7675-4e9d-9869-ebc99153f248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:41.753021 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67ce1-6e04-4319-85fc-fe88341ef096 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:41.759176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:41.759824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:41.760102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:41.760397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] PATH_INFO: `/v3/projects/b422a6c7973d4117bcf2cc60196b16e5` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:41.761668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b422a6c7973d4117bcf2cc60196b16e5)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:41.763788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:41.778729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1004/2023] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:41.779839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7a58f-7675-4e9d-9869-ebc99153f248 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:41.809121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7a58f-7675-4e9d-9869-ebc99153f248 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:41.817696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157355dc-3b75-4f50-a963-474268212d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:41.817696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157355dc-3b75-4f50-a963-474268212d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:41.817696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157355dc-3b75-4f50-a963-474268212d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:41.817696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157355dc-3b75-4f50-a963-474268212d8c admin admin] PATH_INFO: `/v3/projects/4fe5ce9ca3f249b28ad121955b396f9e/users/6db3a4d051444420a843359a8e16fca0/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:41.831781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157355dc-3b75-4f50-a963-474268212d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe5ce9ca3f249b28ad121955b396f9e, user_id=6db3a4d051444420a843359a8e16fca0, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:41.834614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157355dc-3b75-4f50-a963-474268212d8c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:41.889573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:41.930015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:41.933987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1005/2024] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:41 2022] PUT /identity/v3/projects/4fe5ce9ca3f249b28ad121955b396f9e/users/6db3a4d051444420a843359a8e16fca0/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:41.937340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157355dc-3b75-4f50-a963-474268212d8c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:41.939050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-157355dc-3b75-4f50-a963-474268212d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:41.941785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b422a6c7973d4117bcf2cc60196b16e5', 'request_id': 'req-62ff9a2c-6947-4799-9885-78fd130930c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.948587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b422a6c7973d4117bcf2cc60196b16e5', 'request_id': 'req-62ff9a2c-6947-4799-9885-78fd130930c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.955419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b422a6c7973d4117bcf2cc60196b16e5', 'request_id': 'req-62ff9a2c-6947-4799-9885-78fd130930c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:41.996908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157355dc-3b75-4f50-a963-474268212d8c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:42.000588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb5ea4-b34e-448f-9d35-ae157f02746f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:42.001200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5ea4-b34e-448f-9d35-ae157f02746f service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.001509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5ea4-b34e-448f-9d35-ae157f02746f service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.001813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5ea4-b34e-448f-9d35-ae157f02746f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.032872 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] The token cache is being invalidate because project b422a6c7973d4117bcf2cc60196b16e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:42.033800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:42.034633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:42.036937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1020/2025] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:41 2022] DELETE /identity/v3/projects/b422a6c7973d4117bcf2cc60196b16e5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:42.038475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:42.041508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:42.066345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb5ea4-b34e-448f-9d35-ae157f02746f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:42.067593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb5ea4-b34e-448f-9d35-ae157f02746f service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:42.078703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1006/2026] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:42.080341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8333970-9248-4823-b543-78f7309202b9 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.080624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8333970-9248-4823-b543-78f7309202b9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.080893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8333970-9248-4823-b543-78f7309202b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.091667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:42.101218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f8333970-9248-4823-b543-78f7309202b9 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:42.102618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f8333970-9248-4823-b543-78f7309202b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:42.112631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1007/2027] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:42.121726 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19214e-ba1a-4d2b-b83a-8a8c75d06e17 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.122027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19214e-ba1a-4d2b-b83a-8a8c75d06e17 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.122694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19214e-ba1a-4d2b-b83a-8a8c75d06e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.123501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff9a2c-6947-4799-9885-78fd130930c1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:42.128741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bab43-53dc-44a3-8f06-1c8d7f11867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:42.129408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bab43-53dc-44a3-8f06-1c8d7f11867a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.129689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bab43-53dc-44a3-8f06-1c8d7f11867a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.129989 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bab43-53dc-44a3-8f06-1c8d7f11867a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.130669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bab43-53dc-44a3-8f06-1c8d7f11867a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:42.132916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bab43-53dc-44a3-8f06-1c8d7f11867a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:42.146841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1021/2028] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:42.147028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-de19214e-ba1a-4d2b-b83a-8a8c75d06e17 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:42.147028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-de19214e-ba1a-4d2b-b83a-8a8c75d06e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:42.148840 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bab43-53dc-44a3-8f06-1c8d7f11867a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:42.155549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1008/2029] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:42.159507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19214e-ba1a-4d2b-b83a-8a8c75d06e17 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:42.160079 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bab43-53dc-44a3-8f06-1c8d7f11867a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:42.165585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdc39a-3c60-4433-a677-4082483ab5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:42.166326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdc39a-3c60-4433-a677-4082483ab5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.166708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdc39a-3c60-4433-a677-4082483ab5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.167236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdc39a-3c60-4433-a677-4082483ab5ce admin admin] PATH_INFO: `/v3/projects/4fe5ce9ca3f249b28ad121955b396f9e/users/6db3a4d051444420a843359a8e16fca0/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.169186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdc39a-3c60-4433-a677-4082483ab5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe5ce9ca3f249b28ad121955b396f9e, user_id=6db3a4d051444420a843359a8e16fca0, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:42.169989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19214e-ba1a-4d2b-b83a-8a8c75d06e17 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:42.172036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdc39a-3c60-4433-a677-4082483ab5ce admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:42.176842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b78525-c535-4471-bd41-cf39b0f277a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:42.179625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78525-c535-4471-bd41-cf39b0f277a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.179625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78525-c535-4471-bd41-cf39b0f277a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.179625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78525-c535-4471-bd41-cf39b0f277a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.179625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b78525-c535-4471-bd41-cf39b0f277a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:42.180052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b78525-c535-4471-bd41-cf39b0f277a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:42.181789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b78525-c535-4471-bd41-cf39b0f277a7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:42.185766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1022/2030] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:42 2022] PUT /identity/v3/projects/4fe5ce9ca3f249b28ad121955b396f9e/users/6db3a4d051444420a843359a8e16fca0/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:42.196708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3ad8f-984e-47c9-bd55-3003777f5d47 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.197418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1009/2031] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:24:42.197742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3ad8f-984e-47c9-bd55-3003777f5d47 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.198093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3ad8f-984e-47c9-bd55-3003777f5d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.199718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b78525-c535-4471-bd41-cf39b0f277a7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:42.213553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b78525-c535-4471-bd41-cf39b0f277a7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:42.230010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a9f3ad8f-984e-47c9-bd55-3003777f5d47 None None] MFA Rules not processed for user `6db3a4d051444420a843359a8e16fca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:42.231506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a9f3ad8f-984e-47c9-bd55-3003777f5d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:42.276622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30be28a-72f5-4616-974a-c809de0554a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:42.277252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30be28a-72f5-4616-974a-c809de0554a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.277661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30be28a-72f5-4616-974a-c809de0554a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.277996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30be28a-72f5-4616-974a-c809de0554a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.278738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30be28a-72f5-4616-974a-c809de0554a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:42.280995 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30be28a-72f5-4616-974a-c809de0554a6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:42.309733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1023/2032] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:42.323480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3ad8f-984e-47c9-bd55-3003777f5d47 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:42.324959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a9f3ad8f-984e-47c9-bd55-3003777f5d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:42.341175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:42.372268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1010/2033] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:42 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:42.376415 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30be28a-72f5-4616-974a-c809de0554a6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:42.385163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3ad8f-984e-47c9-bd55-3003777f5d47 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:42.450382 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554830a-4449-4cd6-a307-a327a95603be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:42.451453 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554830a-4449-4cd6-a307-a327a95603be service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.451796 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554830a-4449-4cd6-a307-a327a95603be service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.452141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554830a-4449-4cd6-a307-a327a95603be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.458434 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30be28a-72f5-4616-974a-c809de0554a6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:42.464590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063e9f4-9e83-475c-aa79-8c8b00bd5605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:42.465221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063e9f4-9e83-475c-aa79-8c8b00bd5605 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.469328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063e9f4-9e83-475c-aa79-8c8b00bd5605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.469328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063e9f4-9e83-475c-aa79-8c8b00bd5605 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.469328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063e9f4-9e83-475c-aa79-8c8b00bd5605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:42.469328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063e9f4-9e83-475c-aa79-8c8b00bd5605 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:42.555377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554830a-4449-4cd6-a307-a327a95603be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:42.556979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554830a-4449-4cd6-a307-a327a95603be service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:42.581505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1024/2034] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:42.611214 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1011/2035] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:42 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:42.622739 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554830a-4449-4cd6-a307-a327a95603be service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:42.656869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554830a-4449-4cd6-a307-a327a95603be service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:42.662414 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed9052-fee9-4f5f-8090-086e357e2088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:42.662867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed9052-fee9-4f5f-8090-086e357e2088 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.663104 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed9052-fee9-4f5f-8090-086e357e2088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.664170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed9052-fee9-4f5f-8090-086e357e2088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.664852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed9052-fee9-4f5f-8090-086e357e2088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:42.666576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed9052-fee9-4f5f-8090-086e357e2088 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:42.677325 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063e9f4-9e83-475c-aa79-8c8b00bd5605 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:42.689951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063e9f4-9e83-475c-aa79-8c8b00bd5605 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:42.695419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1025/2036] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:42.701892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed9052-fee9-4f5f-8090-086e357e2088 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:42.709840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:42.711568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.712086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.712482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] PATH_INFO: `/v3/users/d885de521d6c40a2b411f23ac5235c23` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.716553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d885de521d6c40a2b411f23ac5235c23)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:42.723077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:42.724603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed9052-fee9-4f5f-8090-086e357e2088 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:42.731936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5e62-c61e-48bb-aded-07dabb94a92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:42.732876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5e62-c61e-48bb-aded-07dabb94a92b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.733117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5e62-c61e-48bb-aded-07dabb94a92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.733492 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5e62-c61e-48bb-aded-07dabb94a92b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.734354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5e62-c61e-48bb-aded-07dabb94a92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:42.736757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5e62-c61e-48bb-aded-07dabb94a92b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:42.743396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:42.757509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1026/2037] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:42.758443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5e62-c61e-48bb-aded-07dabb94a92b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:42.762401 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b15b5e62-c61e-48bb-aded-07dabb94a92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:42.785466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5e62-c61e-48bb-aded-07dabb94a92b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:42.791653 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:42.793043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:42.793043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:42.793043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] PATH_INFO: `/v3/projects/99f64de71592440aa7ff5e6ef9c9d029` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:42.794320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f64de71592440aa7ff5e6ef9c9d029)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:42.796793 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:42.877632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd885de521d6c40a2b411f23ac5235c23'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:42.877632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd885de521d6c40a2b411f23ac5235c23'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:42.883591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd885de521d6c40a2b411f23ac5235c23'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:42.899864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd885de521d6c40a2b411f23ac5235c23'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:42.930358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f64de71592440aa7ff5e6ef9c9d029', 'request_id': 'req-a2c62e17-7a75-4eeb-8743-b2292b9d3840'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:42.936020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f64de71592440aa7ff5e6ef9c9d029', 'request_id': 'req-a2c62e17-7a75-4eeb-8743-b2292b9d3840'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:42.945485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f64de71592440aa7ff5e6ef9c9d029', 'request_id': 'req-a2c62e17-7a75-4eeb-8743-b2292b9d3840'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:42.992814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd885de521d6c40a2b411f23ac5235c23'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.000880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1012/2038] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:42 2022] DELETE /identity/v3/users/d885de521d6c40a2b411f23ac5235c23 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:43.001731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:43.003093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.060777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] The token cache is being invalidate because project 99f64de71592440aa7ff5e6ef9c9d029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:43.061052 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.061719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a2c62e17-7a75-4eeb-8743-b2292b9d3840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.063287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1027/2039] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:42 2022] DELETE /identity/v3/projects/99f64de71592440aa7ff5e6ef9c9d029 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:43.067734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b81ed2-ad33-4db5-815f-83b7bf8756bb admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:43.067999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4d1b4-eb49-4b24-a717-0efd55504bd9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.068283 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4d1b4-eb49-4b24-a717-0efd55504bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.068671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4d1b4-eb49-4b24-a717-0efd55504bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.073430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09593e33-4020-4d34-906c-2f79e17d36e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:43.074112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09593e33-4020-4d34-906c-2f79e17d36e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.074404 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09593e33-4020-4d34-906c-2f79e17d36e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.074641 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09593e33-4020-4d34-906c-2f79e17d36e2 admin admin] PATH_INFO: `/v3/projects/e6b9962ac712489580197895271aac60/users/3534420e35af4cabaad4e2db864be29c/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.091307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6ea4d1b4-eb49-4b24-a717-0efd55504bd9 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:43.092492 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6ea4d1b4-eb49-4b24-a717-0efd55504bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.092864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09593e33-4020-4d34-906c-2f79e17d36e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b9962ac712489580197895271aac60, user_id=3534420e35af4cabaad4e2db864be29c, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:43.095687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09593e33-4020-4d34-906c-2f79e17d36e2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:43.100680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1028/2040] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:43.102495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9a88-8ca5-43cb-954b-cc5b7632dfd3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.102776 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9a88-8ca5-43cb-954b-cc5b7632dfd3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.103046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9a88-8ca5-43cb-954b-cc5b7632dfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.128188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-599a9a88-8ca5-43cb-954b-cc5b7632dfd3 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:43.129418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-599a9a88-8ca5-43cb-954b-cc5b7632dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.137900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1029/2041] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:43.138668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a9a88-8ca5-43cb-954b-cc5b7632dfd3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:43.139858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-599a9a88-8ca5-43cb-954b-cc5b7632dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.194423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a9a88-8ca5-43cb-954b-cc5b7632dfd3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:43.199455 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99bb12-f80f-4a58-8c48-843b573c75bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:43.200001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99bb12-f80f-4a58-8c48-843b573c75bb service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.200292 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99bb12-f80f-4a58-8c48-843b573c75bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.200550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99bb12-f80f-4a58-8c48-843b573c75bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.209629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99bb12-f80f-4a58-8c48-843b573c75bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:43.211727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99bb12-f80f-4a58-8c48-843b573c75bb service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:43.221607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1030/2042] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:43.222942 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182cba9-bd60-4a3e-af0a-b136e5460cb6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.223519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182cba9-bd60-4a3e-af0a-b136e5460cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.223519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182cba9-bd60-4a3e-af0a-b136e5460cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.225716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1013/2043] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:43 2022] PUT /identity/v3/projects/e6b9962ac712489580197895271aac60/users/3534420e35af4cabaad4e2db864be29c/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:43.237225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8abfc6-6b96-4921-9f12-56897bfbb339 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.237543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8abfc6-6b96-4921-9f12-56897bfbb339 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.237811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8abfc6-6b96-4921-9f12-56897bfbb339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.255537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7182cba9-bd60-4a3e-af0a-b136e5460cb6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:43.258543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7182cba9-bd60-4a3e-af0a-b136e5460cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.267856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1d8abfc6-6b96-4921-9f12-56897bfbb339 None None] MFA Rules not processed for user `3534420e35af4cabaad4e2db864be29c`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:43.269139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1d8abfc6-6b96-4921-9f12-56897bfbb339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.324881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:43.338745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1031/2044] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:43.343531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182cba9-bd60-4a3e-af0a-b136e5460cb6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:43.345280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1014/2045] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:43.353301 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182cba9-bd60-4a3e-af0a-b136e5460cb6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:43.357726 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8abfc6-6b96-4921-9f12-56897bfbb339 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:43.358204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6357426-0b46-4ef4-9128-08d8b0a600b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:43.358835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357426-0b46-4ef4-9128-08d8b0a600b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.359167 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357426-0b46-4ef4-9128-08d8b0a600b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.359438 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357426-0b46-4ef4-9128-08d8b0a600b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.359540 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1d8abfc6-6b96-4921-9f12-56897bfbb339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.360108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6357426-0b46-4ef4-9128-08d8b0a600b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:43.360527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6357426-0b46-4ef4-9128-08d8b0a600b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:43.362097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6357426-0b46-4ef4-9128-08d8b0a600b3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:43.374840 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1032/2046] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:43.376457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:43.378784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6357426-0b46-4ef4-9128-08d8b0a600b3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:43.390813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6357426-0b46-4ef4-9128-08d8b0a600b3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:43.395857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc4a44-e241-4655-8d24-5afb1e816584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:43.396568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4a44-e241-4655-8d24-5afb1e816584 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.396746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4a44-e241-4655-8d24-5afb1e816584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.397010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4a44-e241-4655-8d24-5afb1e816584 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.398470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc4a44-e241-4655-8d24-5afb1e816584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:43.400484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc4a44-e241-4655-8d24-5afb1e816584 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:43.442314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8abfc6-6b96-4921-9f12-56897bfbb339 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:43.446446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2556f6-f8f1-4dd3-a61e-c0ccc0938d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:43.447112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2556f6-f8f1-4dd3-a61e-c0ccc0938d9c service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.447389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2556f6-f8f1-4dd3-a61e-c0ccc0938d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.447659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2556f6-f8f1-4dd3-a61e-c0ccc0938d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.461111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2556f6-f8f1-4dd3-a61e-c0ccc0938d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:43.462766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2556f6-f8f1-4dd3-a61e-c0ccc0938d9c service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:43.472209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1015/2047] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:43.497979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2556f6-f8f1-4dd3-a61e-c0ccc0938d9c service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:43.499473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7e2556f6-f8f1-4dd3-a61e-c0ccc0938d9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.506072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1033/2048] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:43 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:43.508284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc4a44-e241-4655-8d24-5afb1e816584 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:43.518050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2556f6-f8f1-4dd3-a61e-c0ccc0938d9c service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:43.575188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc4a44-e241-4655-8d24-5afb1e816584 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:43.590060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485f2c7-b609-4216-8572-6144b7cc57f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:43.591778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485f2c7-b609-4216-8572-6144b7cc57f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.592065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485f2c7-b609-4216-8572-6144b7cc57f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.592435 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485f2c7-b609-4216-8572-6144b7cc57f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.593070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485f2c7-b609-4216-8572-6144b7cc57f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:43.595215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485f2c7-b609-4216-8572-6144b7cc57f5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:43.597735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:43.598376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.598651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.598918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] PATH_INFO: `/v3/users/3534420e35af4cabaad4e2db864be29c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.600096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3534420e35af4cabaad4e2db864be29c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:43.602185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:43.707849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1034/2049] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:43 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:43.708020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485f2c7-b609-4216-8572-6144b7cc57f5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:43.709566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f485f2c7-b609-4216-8572-6144b7cc57f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.721743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485f2c7-b609-4216-8572-6144b7cc57f5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:43.726426 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:43.727042 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.727333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.727590 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] PATH_INFO: `/v3/projects/6e22a71d1ebd45d5972563444e6e3ade` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.728694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e22a71d1ebd45d5972563444e6e3ade)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:43.730625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:43.782106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3534420e35af4cabaad4e2db864be29c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.782759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3534420e35af4cabaad4e2db864be29c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.789739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3534420e35af4cabaad4e2db864be29c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.801566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3534420e35af4cabaad4e2db864be29c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.843236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e22a71d1ebd45d5972563444e6e3ade', 'request_id': 'req-df194010-54d8-4e6d-91ae-95e0c5f18bff'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.848560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e22a71d1ebd45d5972563444e6e3ade', 'request_id': 'req-df194010-54d8-4e6d-91ae-95e0c5f18bff'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.855397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e22a71d1ebd45d5972563444e6e3ade', 'request_id': 'req-df194010-54d8-4e6d-91ae-95e0c5f18bff'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.860503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3534420e35af4cabaad4e2db864be29c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.867295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1016/2050] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:43 2022] DELETE /identity/v3/users/3534420e35af4cabaad4e2db864be29c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:43.870389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:43.870389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.918003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:43.924960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] The token cache is being invalidate because project 6e22a71d1ebd45d5972563444e6e3ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:43.924960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.924960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df194010-54d8-4e6d-91ae-95e0c5f18bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:43.924960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1035/2051] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:43 2022] DELETE /identity/v3/projects/6e22a71d1ebd45d5972563444e6e3ade => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:43.926494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b245-a639-403f-8c1c-e1fc589f4f65 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.926775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b245-a639-403f-8c1c-e1fc589f4f65 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.927051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b245-a639-403f-8c1c-e1fc589f4f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.951164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-49f4b245-a639-403f-8c1c-e1fc589f4f65 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:43.955871 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-49f4b245-a639-403f-8c1c-e1fc589f4f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.955957 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb05d12-d87c-4379-b9c2-a21cbb93d6ca admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:43.960477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ae806-3de7-44df-9768-9dfb5a887da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:43.961066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ae806-3de7-44df-9768-9dfb5a887da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.961448 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ae806-3de7-44df-9768-9dfb5a887da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.961807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ae806-3de7-44df-9768-9dfb5a887da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.962680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ae806-3de7-44df-9768-9dfb5a887da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:43.964697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ae806-3de7-44df-9768-9dfb5a887da6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:43.968872 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1036/2052] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:43.969849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4b245-a639-403f-8c1c-e1fc589f4f65 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:43.971194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-49f4b245-a639-403f-8c1c-e1fc589f4f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.984985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1017/2053] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:43.988779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ae806-3de7-44df-9768-9dfb5a887da6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:43.989591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4b245-a639-403f-8c1c-e1fc589f4f65 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:43.990597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fe5ae806-3de7-44df-9768-9dfb5a887da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:43.995219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:43.995899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:43.996317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:43.996489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] PATH_INFO: `/v3/users/6db3a4d051444420a843359a8e16fca0` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:43.997705 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db3a4d051444420a843359a8e16fca0)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:44.000192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:44.003762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:44.060880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ae806-3de7-44df-9768-9dfb5a887da6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:44.064577 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82c016-704c-4ce8-9e35-7593c009d694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:44.065186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c016-704c-4ce8-9e35-7593c009d694 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:44.065508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c016-704c-4ce8-9e35-7593c009d694 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:44.065777 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c016-704c-4ce8-9e35-7593c009d694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:44.075334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82c016-704c-4ce8-9e35-7593c009d694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:44.076821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82c016-704c-4ce8-9e35-7593c009d694 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:44.094803 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1018/2054] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:44.095797 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82c016-704c-4ce8-9e35-7593c009d694 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:44.104689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2b82c016-704c-4ce8-9e35-7593c009d694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:44.135067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82c016-704c-4ce8-9e35-7593c009d694 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:44.141787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe3358-6061-40d4-9f8f-650a1e2ba5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:44.142484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe3358-6061-40d4-9f8f-650a1e2ba5de admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:44.142834 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe3358-6061-40d4-9f8f-650a1e2ba5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:44.143215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe3358-6061-40d4-9f8f-650a1e2ba5de admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:44.144078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe3358-6061-40d4-9f8f-650a1e2ba5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:44.145909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe3358-6061-40d4-9f8f-650a1e2ba5de admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:44.157497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1019/2055] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:44.167049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe3358-6061-40d4-9f8f-650a1e2ba5de admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:44.181122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe3358-6061-40d4-9f8f-650a1e2ba5de admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:44.187166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fa5fe-cab8-49fc-bbbe-269546c1fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:44.191986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fa5fe-cab8-49fc-bbbe-269546c1fe0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:44.191986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fa5fe-cab8-49fc-bbbe-269546c1fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:44.191986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fa5fe-cab8-49fc-bbbe-269546c1fe0f admin admin] PATH_INFO: `/v3/projects/47940166bdd0499e87f73e18210d40d5/users/fd8d286577bb4f78b77d5c0e65389085/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:44.204108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fa5fe-cab8-49fc-bbbe-269546c1fe0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47940166bdd0499e87f73e18210d40d5, user_id=fd8d286577bb4f78b77d5c0e65389085, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:44.207071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fa5fe-cab8-49fc-bbbe-269546c1fe0f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:44.256858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db3a4d051444420a843359a8e16fca0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:44.257544 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db3a4d051444420a843359a8e16fca0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:44.269601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db3a4d051444420a843359a8e16fca0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:44.277156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db3a4d051444420a843359a8e16fca0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:44.278076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db3a4d051444420a843359a8e16fca0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:44.306150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1020/2056] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:44 2022] PUT /identity/v3/projects/47940166bdd0499e87f73e18210d40d5/users/fd8d286577bb4f78b77d5c0e65389085/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:44.317171 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c94687-98f2-44cf-9f87-3252ca4ea5bb None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:44.317485 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c94687-98f2-44cf-9f87-3252ca4ea5bb None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:44.317761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c94687-98f2-44cf-9f87-3252ca4ea5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:44.346198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-46c94687-98f2-44cf-9f87-3252ca4ea5bb None None] MFA Rules not processed for user `fd8d286577bb4f78b77d5c0e65389085`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:44.347409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-46c94687-98f2-44cf-9f87-3252ca4ea5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:44.392555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1037/2057] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:43 2022] DELETE /identity/v3/users/6db3a4d051444420a843359a8e16fca0 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:44.432651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1021/2058] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:44.433513 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:44.435018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:44.527573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d756359-d447-4c01-b3e8-4d2cdc4e50b8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:44.532304 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa8a6e-fdce-4d75-b61a-3cfd0ad7089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:44.532946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa8a6e-fdce-4d75-b61a-3cfd0ad7089f admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:44.533246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa8a6e-fdce-4d75-b61a-3cfd0ad7089f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:44.533749 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa8a6e-fdce-4d75-b61a-3cfd0ad7089f admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:44.534397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa8a6e-fdce-4d75-b61a-3cfd0ad7089f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:44.536631 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa8a6e-fdce-4d75-b61a-3cfd0ad7089f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:44.577332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c94687-98f2-44cf-9f87-3252ca4ea5bb None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:44.578910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-46c94687-98f2-44cf-9f87-3252ca4ea5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:44.660645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1038/2059] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:44 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:44.664380 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c94687-98f2-44cf-9f87-3252ca4ea5bb None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:44.665531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa8a6e-fdce-4d75-b61a-3cfd0ad7089f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:44.744534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:44.750482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:44.750482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:44.750482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] PATH_INFO: `/v3/projects/e6b9962ac712489580197895271aac60` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:44.750482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b9962ac712489580197895271aac60)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:44.750999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:44.753601 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:44.763299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa8a6e-fdce-4d75-b61a-3cfd0ad7089f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:44.768391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641accce-fec6-4bbf-a676-28c707200b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:44.769105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641accce-fec6-4bbf-a676-28c707200b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:44.769558 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641accce-fec6-4bbf-a676-28c707200b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:44.769935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641accce-fec6-4bbf-a676-28c707200b8c admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:44.770533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641accce-fec6-4bbf-a676-28c707200b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:44.772720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641accce-fec6-4bbf-a676-28c707200b8c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:44.826496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:44.860345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1039/2060] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:44 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:44.861471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641accce-fec6-4bbf-a676-28c707200b8c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:44.869817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b9962ac712489580197895271aac60', 'request_id': 'req-0a8422d9-91b3-434f-9766-c31576d0ff62'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:44.872299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641accce-fec6-4bbf-a676-28c707200b8c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:44.875401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b9962ac712489580197895271aac60', 'request_id': 'req-0a8422d9-91b3-434f-9766-c31576d0ff62'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:44.935266 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf0d01-55c9-400a-be08-33ec9da22b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:44.935881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf0d01-55c9-400a-be08-33ec9da22b98 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:44.936163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf0d01-55c9-400a-be08-33ec9da22b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:44.936427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf0d01-55c9-400a-be08-33ec9da22b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:44.937070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf0d01-55c9-400a-be08-33ec9da22b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:44.938759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf0d01-55c9-400a-be08-33ec9da22b98 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:44.954020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1040/2061] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:44.958152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b9962ac712489580197895271aac60', 'request_id': 'req-0a8422d9-91b3-434f-9766-c31576d0ff62'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:44.958436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf0d01-55c9-400a-be08-33ec9da22b98 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:44.966957 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] The token cache is being invalidate because project e6b9962ac712489580197895271aac60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:44.967312 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:44.967466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf0d01-55c9-400a-be08-33ec9da22b98 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:44.967971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:44.969830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1022/2062] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:44 2022] DELETE /identity/v3/projects/e6b9962ac712489580197895271aac60 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:44.973548 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:44.973548 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:44.978165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4f266-b822-4446-9678-92331d158b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:44.978858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4f266-b822-4446-9678-92331d158b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:44.979138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4f266-b822-4446-9678-92331d158b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:44.979430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4f266-b822-4446-9678-92331d158b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:44.980080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4f266-b822-4446-9678-92331d158b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:44.981739 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4f266-b822-4446-9678-92331d158b3a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:44.993473 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1041/2063] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:44.994855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07d5ba-f688-459d-8968-936e00478a0b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:44.995133 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07d5ba-f688-459d-8968-936e00478a0b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:44.995422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07d5ba-f688-459d-8968-936e00478a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.012755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8422d9-91b3-434f-9766-c31576d0ff62 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.014655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7e07d5ba-f688-459d-8968-936e00478a0b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:45.016058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7e07d5ba-f688-459d-8968-936e00478a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:45.017652 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.018284 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.018586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.018851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] PATH_INFO: `/v3/projects/4fe5ce9ca3f249b28ad121955b396f9e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.019944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe5ce9ca3f249b28ad121955b396f9e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.021875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.024948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1042/2064] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:45.025497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07d5ba-f688-459d-8968-936e00478a0b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.026703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7e07d5ba-f688-459d-8968-936e00478a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:45.040191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07d5ba-f688-459d-8968-936e00478a0b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.049245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126d8a6-3eb3-4e6c-9f60-9613b77491be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.049861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d8a6-3eb3-4e6c-9f60-9613b77491be admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.050140 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d8a6-3eb3-4e6c-9f60-9613b77491be admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.050528 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126d8a6-3eb3-4e6c-9f60-9613b77491be admin admin] PATH_INFO: `/v3/projects/dc88a37666544cfab3fff4d9760a67bb/users/292c331daa4e4b57a2b55b127c2874d0/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.071607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126d8a6-3eb3-4e6c-9f60-9613b77491be admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc88a37666544cfab3fff4d9760a67bb, user_id=292c331daa4e4b57a2b55b127c2874d0, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.074611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126d8a6-3eb3-4e6c-9f60-9613b77491be admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.188587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1043/2065] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:45 2022] PUT /identity/v3/projects/dc88a37666544cfab3fff4d9760a67bb/users/292c331daa4e4b57a2b55b127c2874d0/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:45.191067 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0326ff5-d746-424e-8256-a855ed6b6846 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.191067 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0326ff5-d746-424e-8256-a855ed6b6846 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.191067 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0326ff5-d746-424e-8256-a855ed6b6846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.199457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe5ce9ca3f249b28ad121955b396f9e', 'request_id': 'req-5f1dd277-a065-43e3-97a0-2d9f10ed7197'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:45.205687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe5ce9ca3f249b28ad121955b396f9e', 'request_id': 'req-5f1dd277-a065-43e3-97a0-2d9f10ed7197'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:45.213113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c0326ff5-d746-424e-8256-a855ed6b6846 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:45.214556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c0326ff5-d746-424e-8256-a855ed6b6846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:45.283362 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe5ce9ca3f249b28ad121955b396f9e', 'request_id': 'req-5f1dd277-a065-43e3-97a0-2d9f10ed7197'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:45.290654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1044/2066] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:45.297114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14871-3d52-4928-aaff-918149dd1e42 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.297445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14871-3d52-4928-aaff-918149dd1e42 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.297704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14871-3d52-4928-aaff-918149dd1e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.304751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] The token cache is being invalidate because project 4fe5ce9ca3f249b28ad121955b396f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:45.304751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:45.304751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:45.310283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1023/2067] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:44 2022] DELETE /identity/v3/projects/4fe5ce9ca3f249b28ad121955b396f9e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:45.311453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.312910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:45.328315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dd277-a065-43e3-97a0-2d9f10ed7197 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.337549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ed495-bf93-4682-a570-3f775b56b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.337549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ed495-bf93-4682-a570-3f775b56b2cc admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.337549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ed495-bf93-4682-a570-3f775b56b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.337549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ed495-bf93-4682-a570-3f775b56b2cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.338034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ed495-bf93-4682-a570-3f775b56b2cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:45.338034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ed495-bf93-4682-a570-3f775b56b2cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.338195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-86a14871-3d52-4928-aaff-918149dd1e42 None None] MFA Rules not processed for user `292c331daa4e4b57a2b55b127c2874d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:45.338291 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ed495-bf93-4682-a570-3f775b56b2cc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.338375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-86a14871-3d52-4928-aaff-918149dd1e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:45.364749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1024/2068] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:45.367072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c637-4361-4a93-8af5-505231284f7e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.367364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c637-4361-4a93-8af5-505231284f7e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.367800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c637-4361-4a93-8af5-505231284f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.394112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2605c637-4361-4a93-8af5-505231284f7e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:45.399474 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2605c637-4361-4a93-8af5-505231284f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:45.407590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1025/2069] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:45.408440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605c637-4361-4a93-8af5-505231284f7e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.419099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605c637-4361-4a93-8af5-505231284f7e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.424749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa86978-9d3e-48b1-8bdd-6c193a9af097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.425394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa86978-9d3e-48b1-8bdd-6c193a9af097 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.425659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa86978-9d3e-48b1-8bdd-6c193a9af097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.425925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa86978-9d3e-48b1-8bdd-6c193a9af097 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.426554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa86978-9d3e-48b1-8bdd-6c193a9af097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.428495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa86978-9d3e-48b1-8bdd-6c193a9af097 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.440250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1045/2070] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:45.441576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c99a6-bfb8-4210-bd0e-be822b604978 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.441872 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c99a6-bfb8-4210-bd0e-be822b604978 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.442129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c99a6-bfb8-4210-bd0e-be822b604978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.468006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-593c99a6-bfb8-4210-bd0e-be822b604978 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:45.469588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-593c99a6-bfb8-4210-bd0e-be822b604978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:45.479137 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1046/2071] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:45.480656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c99a6-bfb8-4210-bd0e-be822b604978 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.481992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-593c99a6-bfb8-4210-bd0e-be822b604978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:45.494298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c99a6-bfb8-4210-bd0e-be822b604978 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.499273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76fa1-bbbd-4289-9bd9-6c07a8c0711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.499920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76fa1-bbbd-4289-9bd9-6c07a8c0711f admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.500197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76fa1-bbbd-4289-9bd9-6c07a8c0711f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.500460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76fa1-bbbd-4289-9bd9-6c07a8c0711f admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.501114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac76fa1-bbbd-4289-9bd9-6c07a8c0711f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.503174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac76fa1-bbbd-4289-9bd9-6c07a8c0711f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.543513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1026/2072] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:45 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:45.544953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa86978-9d3e-48b1-8bdd-6c193a9af097 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.624781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa86978-9d3e-48b1-8bdd-6c193a9af097 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.629554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27d572-c88f-402c-9c9e-b0fe690657ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.630610 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27d572-c88f-402c-9c9e-b0fe690657ec admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.630885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27d572-c88f-402c-9c9e-b0fe690657ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.632820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27d572-c88f-402c-9c9e-b0fe690657ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.632820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27d572-c88f-402c-9c9e-b0fe690657ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:45.632820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27d572-c88f-402c-9c9e-b0fe690657ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.638597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27d572-c88f-402c-9c9e-b0fe690657ec admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.642502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1047/2073] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:45 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:45.646474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76fa1-bbbd-4289-9bd9-6c07a8c0711f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.656205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1027/2074] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:45.657543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27d572-c88f-402c-9c9e-b0fe690657ec admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.668492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27d572-c88f-402c-9c9e-b0fe690657ec admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.723333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76fa1-bbbd-4289-9bd9-6c07a8c0711f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.731268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390c596-ab79-40f6-a376-83a2977c27a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.732000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390c596-ab79-40f6-a376-83a2977c27a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.732369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390c596-ab79-40f6-a376-83a2977c27a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.732677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390c596-ab79-40f6-a376-83a2977c27a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.733319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390c596-ab79-40f6-a376-83a2977c27a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.738729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390c596-ab79-40f6-a376-83a2977c27a2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.738883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecf00a-e3db-4149-83ac-21b952ad8bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.739671 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecf00a-e3db-4149-83ac-21b952ad8bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.739847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecf00a-e3db-4149-83ac-21b952ad8bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.740121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecf00a-e3db-4149-83ac-21b952ad8bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.740744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecf00a-e3db-4149-83ac-21b952ad8bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.742895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecf00a-e3db-4149-83ac-21b952ad8bc2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.763373 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:45.822937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:45.822937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1048/2075] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:45 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:45.822937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390c596-ab79-40f6-a376-83a2977c27a2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.827053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1028/2076] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:45 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:45.827053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecf00a-e3db-4149-83ac-21b952ad8bc2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.832296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390c596-ab79-40f6-a376-83a2977c27a2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.837669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f78295-bed5-4028-a7e4-951ad961b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.837905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecf00a-e3db-4149-83ac-21b952ad8bc2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.838288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f78295-bed5-4028-a7e4-951ad961b75d admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.838571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f78295-bed5-4028-a7e4-951ad961b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.838843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f78295-bed5-4028-a7e4-951ad961b75d admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.839468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f78295-bed5-4028-a7e4-951ad961b75d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.841414 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f78295-bed5-4028-a7e4-951ad961b75d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.843230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068538e4-009a-4e54-b5bb-2beb3ea77f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.843838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068538e4-009a-4e54-b5bb-2beb3ea77f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.844155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068538e4-009a-4e54-b5bb-2beb3ea77f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.844381 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068538e4-009a-4e54-b5bb-2beb3ea77f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.845021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068538e4-009a-4e54-b5bb-2beb3ea77f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.846709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068538e4-009a-4e54-b5bb-2beb3ea77f48 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.858485 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1029/2077] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:45.859344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068538e4-009a-4e54-b5bb-2beb3ea77f48 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.869887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068538e4-009a-4e54-b5bb-2beb3ea77f48 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.875002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935fef8-fb14-4bb0-b289-5ec166445d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.875651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935fef8-fb14-4bb0-b289-5ec166445d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.876003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935fef8-fb14-4bb0-b289-5ec166445d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.876270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935fef8-fb14-4bb0-b289-5ec166445d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.878601 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935fef8-fb14-4bb0-b289-5ec166445d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.878721 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935fef8-fb14-4bb0-b289-5ec166445d83 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.892369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1030/2078] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:45.892369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935fef8-fb14-4bb0-b289-5ec166445d83 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.902213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935fef8-fb14-4bb0-b289-5ec166445d83 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.907246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213864-795c-40de-b94f-eac02361cab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.907846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213864-795c-40de-b94f-eac02361cab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.908121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213864-795c-40de-b94f-eac02361cab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.908439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213864-795c-40de-b94f-eac02361cab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.909467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8213864-795c-40de-b94f-eac02361cab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.911401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8213864-795c-40de-b94f-eac02361cab1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:45.914625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1049/2079] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:45 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:45.915630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f78295-bed5-4028-a7e4-951ad961b75d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.922856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1031/2080] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:45.923741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213864-795c-40de-b94f-eac02361cab1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:45.934799 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213864-795c-40de-b94f-eac02361cab1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.980749 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f78295-bed5-4028-a7e4-951ad961b75d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:45.985480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4618-d67f-47be-9885-a0b5057f9cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.986176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4618-d67f-47be-9885-a0b5057f9cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.986476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4618-d67f-47be-9885-a0b5057f9cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.986752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4618-d67f-47be-9885-a0b5057f9cc1 admin admin] PATH_INFO: `/v3/projects/829b6b87b08849379d38ea77f5977080/users/d5b484f790ad4254884dfd5057147ac6/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.992188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862c201-ea09-4c9a-a362-0efb1e3b44f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:45.992889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c201-ea09-4c9a-a362-0efb1e3b44f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:45.993164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c201-ea09-4c9a-a362-0efb1e3b44f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:45.993460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c201-ea09-4c9a-a362-0efb1e3b44f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:45.994077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862c201-ea09-4c9a-a362-0efb1e3b44f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:45.995990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862c201-ea09-4c9a-a362-0efb1e3b44f1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.001733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e4618-d67f-47be-9885-a0b5057f9cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829b6b87b08849379d38ea77f5977080, user_id=d5b484f790ad4254884dfd5057147ac6, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.004440 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e4618-d67f-47be-9885-a0b5057f9cc1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.049434 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:46.077951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1032/2081] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:45 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:46.078677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862c201-ea09-4c9a-a362-0efb1e3b44f1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.080916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1050/2082] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:45 2022] PUT /identity/v3/projects/829b6b87b08849379d38ea77f5977080/users/d5b484f790ad4254884dfd5057147ac6/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:46.082307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4618-d67f-47be-9885-a0b5057f9cc1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.090705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862c201-ea09-4c9a-a362-0efb1e3b44f1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.119730 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:46.147751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4618-d67f-47be-9885-a0b5057f9cc1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.150180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452e042-6413-4de8-a737-1616b4696c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.150826 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e042-6413-4de8-a737-1616b4696c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.151102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e042-6413-4de8-a737-1616b4696c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.151376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e042-6413-4de8-a737-1616b4696c7d admin admin] PATH_INFO: `/v3/projects/d1168c28035f45daa521dec7844e37bd/users/64c63d6be76f4441b6c40a4eb58c947c/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.152856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67130713-1e68-4530-baca-958da5efe896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.153519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67130713-1e68-4530-baca-958da5efe896 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.153797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67130713-1e68-4530-baca-958da5efe896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.154062 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67130713-1e68-4530-baca-958da5efe896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.154761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67130713-1e68-4530-baca-958da5efe896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.156478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67130713-1e68-4530-baca-958da5efe896 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.167672 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1051/2083] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:46.168750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452e042-6413-4de8-a737-1616b4696c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1168c28035f45daa521dec7844e37bd, user_id=64c63d6be76f4441b6c40a4eb58c947c, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.171589 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452e042-6413-4de8-a737-1616b4696c7d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.171723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67130713-1e68-4530-baca-958da5efe896 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.182242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67130713-1e68-4530-baca-958da5efe896 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.187241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb9126-bd07-47a5-b429-37e421891b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.187825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb9126-bd07-47a5-b429-37e421891b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.188095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb9126-bd07-47a5-b429-37e421891b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.188359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb9126-bd07-47a5-b429-37e421891b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.188985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb9126-bd07-47a5-b429-37e421891b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.190602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb9126-bd07-47a5-b429-37e421891b02 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.200810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1052/2084] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:46.201801 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb9126-bd07-47a5-b429-37e421891b02 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.209101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:46.213268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb9126-bd07-47a5-b429-37e421891b02 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.218035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5d3e9-8973-4091-9898-18019d32fe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.218671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d3e9-8973-4091-9898-18019d32fe40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.218945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d3e9-8973-4091-9898-18019d32fe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.219215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d3e9-8973-4091-9898-18019d32fe40 admin admin] PATH_INFO: `/v3/projects/829b6b87b08849379d38ea77f5977080/users/d5b484f790ad4254884dfd5057147ac6/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.221194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5d3e9-8973-4091-9898-18019d32fe40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829b6b87b08849379d38ea77f5977080, user_id=d5b484f790ad4254884dfd5057147ac6, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.223841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5d3e9-8973-4091-9898-18019d32fe40 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.236227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1053/2085] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:46 2022] PUT /identity/v3/projects/829b6b87b08849379d38ea77f5977080/users/d5b484f790ad4254884dfd5057147ac6/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:46.237091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5d3e9-8973-4091-9898-18019d32fe40 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.300651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5d3e9-8973-4091-9898-18019d32fe40 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.305638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1033/2086] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:46 2022] PUT /identity/v3/projects/d1168c28035f45daa521dec7844e37bd/users/64c63d6be76f4441b6c40a4eb58c947c/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:46.311625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48c9aa-14a6-488b-bc28-55ac00f240f3 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.312241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48c9aa-14a6-488b-bc28-55ac00f240f3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.312241 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48c9aa-14a6-488b-bc28-55ac00f240f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.342870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5e48c9aa-14a6-488b-bc28-55ac00f240f3 None None] MFA Rules not processed for user `d5b484f790ad4254884dfd5057147ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:46.344003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5e48c9aa-14a6-488b-bc28-55ac00f240f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:46.358225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d492f-f0ee-45ac-b750-6bb524eb643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.375839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d492f-f0ee-45ac-b750-6bb524eb643d admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.375839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d492f-f0ee-45ac-b750-6bb524eb643d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.375839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d492f-f0ee-45ac-b750-6bb524eb643d admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.375839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d492f-f0ee-45ac-b750-6bb524eb643d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.375839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d492f-f0ee-45ac-b750-6bb524eb643d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.375839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1054/2087] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:46.376281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907db37b-3d64-4d58-877f-bb9b3d92454f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.376281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907db37b-3d64-4d58-877f-bb9b3d92454f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.376281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907db37b-3d64-4d58-877f-bb9b3d92454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.394373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-907db37b-3d64-4d58-877f-bb9b3d92454f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:46.395565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-907db37b-3d64-4d58-877f-bb9b3d92454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:46.404068 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1055/2088] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:46.407997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907db37b-3d64-4d58-877f-bb9b3d92454f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.415131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907db37b-3d64-4d58-877f-bb9b3d92454f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.419370 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1034/2089] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:46.420744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48c9aa-14a6-488b-bc28-55ac00f240f3 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.422046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5e48c9aa-14a6-488b-bc28-55ac00f240f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:46.424075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c097a-02c5-4238-ab38-b0770b8392a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.424828 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c097a-02c5-4238-ab38-b0770b8392a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.425039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c097a-02c5-4238-ab38-b0770b8392a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.425787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c097a-02c5-4238-ab38-b0770b8392a4 admin admin] PATH_INFO: `/v3/projects/ded233008f6f467b84fb4399005c9b36/users/5c6e06300dcb4ea2a0410eb55b52e81d/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.447290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c097a-02c5-4238-ab38-b0770b8392a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded233008f6f467b84fb4399005c9b36, user_id=5c6e06300dcb4ea2a0410eb55b52e81d, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.450110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c097a-02c5-4238-ab38-b0770b8392a4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.479644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48c9aa-14a6-488b-bc28-55ac00f240f3 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.483319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5af08b-4bdc-4566-b0d8-4c9a8b17aaa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.483918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5af08b-4bdc-4566-b0d8-4c9a8b17aaa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.484194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5af08b-4bdc-4566-b0d8-4c9a8b17aaa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.484463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5af08b-4bdc-4566-b0d8-4c9a8b17aaa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.493828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5af08b-4bdc-4566-b0d8-4c9a8b17aaa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.495406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5af08b-4bdc-4566-b0d8-4c9a8b17aaa1 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.500584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:46.506628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1035/2090] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:46.508070 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5af08b-4bdc-4566-b0d8-4c9a8b17aaa1 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.509337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4d5af08b-4bdc-4566-b0d8-4c9a8b17aaa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:46.530001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1056/2091] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:46 2022] PUT /identity/v3/projects/ded233008f6f467b84fb4399005c9b36/users/5c6e06300dcb4ea2a0410eb55b52e81d/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:46.541619 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900cc4a-589d-478b-9804-d617190c0f35 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.541913 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900cc4a-589d-478b-9804-d617190c0f35 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.542175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900cc4a-589d-478b-9804-d617190c0f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.568584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5af08b-4bdc-4566-b0d8-4c9a8b17aaa1 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.570477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b900cc4a-589d-478b-9804-d617190c0f35 None None] MFA Rules not processed for user `5c6e06300dcb4ea2a0410eb55b52e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:46.571795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b900cc4a-589d-478b-9804-d617190c0f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:46.620074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81020d88-bbbe-4270-a90f-188e784daf4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.620694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81020d88-bbbe-4270-a90f-188e784daf4b service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.621021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81020d88-bbbe-4270-a90f-188e784daf4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.621558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81020d88-bbbe-4270-a90f-188e784daf4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.623363 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-81020d88-bbbe-4270-a90f-188e784daf4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:46.644117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1057/2092] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:46.660677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900cc4a-589d-478b-9804-d617190c0f35 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.662337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b900cc4a-589d-478b-9804-d617190c0f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:46.675102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900cc4a-589d-478b-9804-d617190c0f35 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.682792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832745b-ab89-4714-94e6-91aa8b393472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.684971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832745b-ab89-4714-94e6-91aa8b393472 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.685228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832745b-ab89-4714-94e6-91aa8b393472 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.687996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832745b-ab89-4714-94e6-91aa8b393472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.693742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=84,keystone:INSERT=5,keystone:DELETE=11 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:46.695657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81020d88-bbbe-4270-a90f-188e784daf4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.695657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81020d88-bbbe-4270-a90f-188e784daf4b service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.702627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1036/2093] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:46.704973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832745b-ab89-4714-94e6-91aa8b393472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.706875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832745b-ab89-4714-94e6-91aa8b393472 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.724804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1058/2094] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:46.736077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:47.378221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:47.539288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:48.021602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbd80d-cfd3-4c49-a1d1-a257bad4c6f8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:48.022128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbd80d-cfd3-4c49-a1d1-a257bad4c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:48.023065 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbd80d-cfd3-4c49-a1d1-a257bad4c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:48.092662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9dbbd80d-cfd3-4c49-a1d1-a257bad4c6f8 None None] MFA Rules not processed for user `64c63d6be76f4441b6c40a4eb58c947c`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:48.102637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9dbbd80d-cfd3-4c49-a1d1-a257bad4c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:48.202925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1037/2095] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:48.214426 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832745b-ab89-4714-94e6-91aa8b393472 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:48.223270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832745b-ab89-4714-94e6-91aa8b393472 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:48.227976 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1de254-2b72-4942-9f3c-d610ce98c726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:48.228580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de254-2b72-4942-9f3c-d610ce98c726 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:48.228862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de254-2b72-4942-9f3c-d610ce98c726 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:48.229135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de254-2b72-4942-9f3c-d610ce98c726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:48.237737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1de254-2b72-4942-9f3c-d610ce98c726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:48.239183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1de254-2b72-4942-9f3c-d610ce98c726 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:48.249097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1059/2096] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:48.518720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:48.661000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:49.277716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:49.913731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:49.981450 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:50.062210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbd80d-cfd3-4c49-a1d1-a257bad4c6f8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:50.072539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbd80d-cfd3-4c49-a1d1-a257bad4c6f8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:50.076516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54e3a5-c77c-4d98-a8ca-3ad294286475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:50.077125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54e3a5-c77c-4d98-a8ca-3ad294286475 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:50.077429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54e3a5-c77c-4d98-a8ca-3ad294286475 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:50.077877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54e3a5-c77c-4d98-a8ca-3ad294286475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:50.078306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5acdf1-bf09-43e4-b327-3a109a944a34 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:50.078645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5acdf1-bf09-43e4-b327-3a109a944a34 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:50.078940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5acdf1-bf09-43e4-b327-3a109a944a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:50.099342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-db5acdf1-bf09-43e4-b327-3a109a944a34 None None] MFA Rules not processed for user `64c63d6be76f4441b6c40a4eb58c947c`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:50.100561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-db5acdf1-bf09-43e4-b327-3a109a944a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:50.121487 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1060/2097] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:50.149052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54e3a5-c77c-4d98-a8ca-3ad294286475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:50.150857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54e3a5-c77c-4d98-a8ca-3ad294286475 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:50.173173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1038/2098] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:50.770221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:51.169728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9a67-2ac1-42a6-a450-3d7666e072c8 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:51.170231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9a67-2ac1-42a6-a450-3d7666e072c8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:51.170328 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9a67-2ac1-42a6-a450-3d7666e072c8 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:51.171601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1061/2099] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 17 16:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:24:51.215511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378135d-0b70-44bd-a275-ced55b064c0f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:51.222674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378135d-0b70-44bd-a275-ced55b064c0f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:51.222674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378135d-0b70-44bd-a275-ced55b064c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:51.239744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2378135d-0b70-44bd-a275-ced55b064c0f None None] MFA Rules not processed for user `da5e1da2196b4ff399921809f40d3002`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:51.245186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2378135d-0b70-44bd-a275-ced55b064c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:51.309409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1039/2100] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 17 16:24:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:51.320898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9a67-2ac1-42a6-a450-3d7666e072c8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:51.322722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-130a9a67-2ac1-42a6-a450-3d7666e072c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:51.339764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9a67-2ac1-42a6-a450-3d7666e072c8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:51.345341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aef1c8-d6a6-49bb-9b65-9a5206d8263a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da5e1da2196b4ff399921809f40d3002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:51.346341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef1c8-d6a6-49bb-9b65-9a5206d8263a service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:51.346614 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef1c8-d6a6-49bb-9b65-9a5206d8263a service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:51.346881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef1c8-d6a6-49bb-9b65-9a5206d8263a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:51.355538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aef1c8-d6a6-49bb-9b65-9a5206d8263a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:51.358045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aef1c8-d6a6-49bb-9b65-9a5206d8263a service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:51.374278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378135d-0b70-44bd-a275-ced55b064c0f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:51.375882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2378135d-0b70-44bd-a275-ced55b064c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:51.377399 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1062/2101] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:51.449392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378135d-0b70-44bd-a275-ced55b064c0f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:51.454001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:51.454657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:51.454928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:51.455194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] PATH_INFO: `/v3/users/22c7c123b98b45cf8182ce553b0be9fe` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:51.456344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c7c123b98b45cf8182ce553b0be9fe)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:51.458316 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:51.644143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c7c123b98b45cf8182ce553b0be9fe'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:51.644819 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c7c123b98b45cf8182ce553b0be9fe'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:51.651749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c7c123b98b45cf8182ce553b0be9fe'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:51.667273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c7c123b98b45cf8182ce553b0be9fe'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:51.791623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c7c123b98b45cf8182ce553b0be9fe'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:51.801033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1040/2102] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:51 2022] DELETE /identity/v3/users/22c7c123b98b45cf8182ce553b0be9fe => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:51.837506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:52.038166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aef1c8-d6a6-49bb-9b65-9a5206d8263a service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:52.047400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aef1c8-d6a6-49bb-9b65-9a5206d8263a service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:52.073625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:52.075461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:52.106737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e41044-0e1c-4251-a8c1-b6b4dabfbb36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:52.107345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41044-0e1c-4251-a8c1-b6b4dabfbb36 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:52.107620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41044-0e1c-4251-a8c1-b6b4dabfbb36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:52.107893 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41044-0e1c-4251-a8c1-b6b4dabfbb36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:52.110194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-32e41044-0e1c-4251-a8c1-b6b4dabfbb36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:52.166375 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b41df4-ac15-4b39-855b-252968e07151 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:52.171205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:52.172177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:52.172672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:52.173073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] PATH_INFO: `/v3/projects/02623f56e00a49869c562ce98f0cd39b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:52.174359 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02623f56e00a49869c562ce98f0cd39b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:52.176464 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:52.187102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e41044-0e1c-4251-a8c1-b6b4dabfbb36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:52.188556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e41044-0e1c-4251-a8c1-b6b4dabfbb36 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:52.198650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1063/2103] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:52.282697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02623f56e00a49869c562ce98f0cd39b', 'request_id': 'req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:52.290177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02623f56e00a49869c562ce98f0cd39b', 'request_id': 'req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:52.363281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02623f56e00a49869c562ce98f0cd39b', 'request_id': 'req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:52.366601 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:52.375857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] The token cache is being invalidate because project 02623f56e00a49869c562ce98f0cd39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:52.376147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:52.376789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-20113bf9-d1ac-496b-8aa0-41006a3dd1f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:52.378987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1041/2104] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:52 2022] DELETE /identity/v3/projects/02623f56e00a49869c562ce98f0cd39b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:52.384035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072627f-c742-437f-8617-6c2d8b93a55c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:52.386496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072627f-c742-437f-8617-6c2d8b93a55c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:52.386496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072627f-c742-437f-8617-6c2d8b93a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:52.392090 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:52.405049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2072627f-c742-437f-8617-6c2d8b93a55c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:52.406285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2072627f-c742-437f-8617-6c2d8b93a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:52.476273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1064/2105] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:52.486327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d037ed-53ed-4a3c-b590-fde9dcc0f6a5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:52.486509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d037ed-53ed-4a3c-b590-fde9dcc0f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:52.486876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d037ed-53ed-4a3c-b590-fde9dcc0f6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:52.515948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-98d037ed-53ed-4a3c-b590-fde9dcc0f6a5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:52.517132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-98d037ed-53ed-4a3c-b590-fde9dcc0f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:52.531206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1042/2106] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:24:52.535403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072627f-c742-437f-8617-6c2d8b93a55c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:52.545641 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072627f-c742-437f-8617-6c2d8b93a55c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:52.550401 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2eba7d-d529-4c5c-8f8d-2c79a483a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:52.551029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eba7d-d529-4c5c-8f8d-2c79a483a04e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:52.551307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eba7d-d529-4c5c-8f8d-2c79a483a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:52.551579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2eba7d-d529-4c5c-8f8d-2c79a483a04e admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:52.552228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2eba7d-d529-4c5c-8f8d-2c79a483a04e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:52.552525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2eba7d-d529-4c5c-8f8d-2c79a483a04e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:52.555134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2eba7d-d529-4c5c-8f8d-2c79a483a04e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:52.566967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1065/2107] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:52.572509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:52.572509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d037ed-53ed-4a3c-b590-fde9dcc0f6a5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:52.581093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d037ed-53ed-4a3c-b590-fde9dcc0f6a5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:52.586363 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606f9c7-8f98-4315-be41-45a86411b951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:52.586972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606f9c7-8f98-4315-be41-45a86411b951 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:52.587252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606f9c7-8f98-4315-be41-45a86411b951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:52.587524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606f9c7-8f98-4315-be41-45a86411b951 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:52.588184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606f9c7-8f98-4315-be41-45a86411b951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:52.590494 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606f9c7-8f98-4315-be41-45a86411b951 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:52.649528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:52.708328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1043/2108] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:52 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:52.712936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2eba7d-d529-4c5c-8f8d-2c79a483a04e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:52.723543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2eba7d-d529-4c5c-8f8d-2c79a483a04e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:52.783925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837ba24-f667-4b2d-9cbe-ba12ea7caff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:52.784931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837ba24-f667-4b2d-9cbe-ba12ea7caff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:52.785210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837ba24-f667-4b2d-9cbe-ba12ea7caff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:52.785518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837ba24-f667-4b2d-9cbe-ba12ea7caff0 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:52.786151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837ba24-f667-4b2d-9cbe-ba12ea7caff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:52.788063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837ba24-f667-4b2d-9cbe-ba12ea7caff0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:52.791681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:52.868100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1066/2109] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:52 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:52.872052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606f9c7-8f98-4315-be41-45a86411b951 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:52.884316 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606f9c7-8f98-4315-be41-45a86411b951 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:52.889960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba676-c7a5-4228-822c-900e0f84a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:52.890701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba676-c7a5-4228-822c-900e0f84a0cf admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:52.891048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba676-c7a5-4228-822c-900e0f84a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:52.891322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba676-c7a5-4228-822c-900e0f84a0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:52.892021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ba676-c7a5-4228-822c-900e0f84a0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:52.894131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ba676-c7a5-4228-822c-900e0f84a0cf admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:52.905329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1044/2110] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:52.909695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837ba24-f667-4b2d-9cbe-ba12ea7caff0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:52.923948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837ba24-f667-4b2d-9cbe-ba12ea7caff0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:52.930172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443d995-7877-45a1-9f5a-80ab016aa287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:52.930910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443d995-7877-45a1-9f5a-80ab016aa287 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:52.931249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443d995-7877-45a1-9f5a-80ab016aa287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:52.931586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443d995-7877-45a1-9f5a-80ab016aa287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:52.932356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443d995-7877-45a1-9f5a-80ab016aa287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:52.935099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443d995-7877-45a1-9f5a-80ab016aa287 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:52.951452 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1067/2111] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:52.958113 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba676-c7a5-4228-822c-900e0f84a0cf admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:52.968741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba676-c7a5-4228-822c-900e0f84a0cf admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:52.974342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0817-614a-4fc6-9234-1f95c7ef5c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:52.975064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0817-614a-4fc6-9234-1f95c7ef5c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:52.976240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0817-614a-4fc6-9234-1f95c7ef5c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:52.976802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f0817-614a-4fc6-9234-1f95c7ef5c34 admin admin] PATH_INFO: `/v3/projects/873132bc2d52427eace2fb03ad6355aa/users/07b2fcfa197e4e93852c9a04aa8f008a/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:52.995418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f0817-614a-4fc6-9234-1f95c7ef5c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873132bc2d52427eace2fb03ad6355aa, user_id=07b2fcfa197e4e93852c9a04aa8f008a, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:52.998202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f0817-614a-4fc6-9234-1f95c7ef5c34 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:53.076226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1045/2112] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:52 2022] PUT /identity/v3/projects/873132bc2d52427eace2fb03ad6355aa/users/07b2fcfa197e4e93852c9a04aa8f008a/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:53.081321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dfd69-65ad-430a-8fd5-bc2ae20baa5f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:53.081634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dfd69-65ad-430a-8fd5-bc2ae20baa5f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:53.081908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dfd69-65ad-430a-8fd5-bc2ae20baa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:53.100958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-db3dfd69-65ad-430a-8fd5-bc2ae20baa5f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:53.102174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-db3dfd69-65ad-430a-8fd5-bc2ae20baa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:53.172627 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1068/2113] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:53.186242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0817-614a-4fc6-9234-1f95c7ef5c34 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:53.188086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ea0f0817-614a-4fc6-9234-1f95c7ef5c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:53.247824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f0817-614a-4fc6-9234-1f95c7ef5c34 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:53.251916 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467c4f6-2d60-41ca-88c4-838502457390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:53.252681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c4f6-2d60-41ca-88c4-838502457390 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:53.252962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c4f6-2d60-41ca-88c4-838502457390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:53.253238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467c4f6-2d60-41ca-88c4-838502457390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:53.263350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467c4f6-2d60-41ca-88c4-838502457390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:53.264779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467c4f6-2d60-41ca-88c4-838502457390 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:53.275819 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1046/2114] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:55.661153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dfd69-65ad-430a-8fd5-bc2ae20baa5f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:55.664373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-db3dfd69-65ad-430a-8fd5-bc2ae20baa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:55.692193 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dfd69-65ad-430a-8fd5-bc2ae20baa5f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:55.702029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:55.703130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:55.703413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:55.703683 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] PATH_INFO: `/v3/users/5c6e06300dcb4ea2a0410eb55b52e81d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:55.705558 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6e06300dcb4ea2a0410eb55b52e81d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:55.707614 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:55.711257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:55.945402 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6e06300dcb4ea2a0410eb55b52e81d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:55.946896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6e06300dcb4ea2a0410eb55b52e81d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:55.978807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6e06300dcb4ea2a0410eb55b52e81d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:55.989989 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6e06300dcb4ea2a0410eb55b52e81d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:55.991685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6e06300dcb4ea2a0410eb55b52e81d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:56.107348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1069/2115] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:55 2022] DELETE /identity/v3/users/5c6e06300dcb4ea2a0410eb55b52e81d => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:56.111974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b27e-c4e0-4e04-a073-45e6e7c8ea57 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:56.112466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b27e-c4e0-4e04-a073-45e6e7c8ea57 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:56.113249 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b27e-c4e0-4e04-a073-45e6e7c8ea57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:56.161931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8af3b27e-c4e0-4e04-a073-45e6e7c8ea57 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:56.164709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8af3b27e-c4e0-4e04-a073-45e6e7c8ea57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:56.244221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1047/2116] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:56.257818 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:56.261241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:56.367910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6e1f2-a26d-4a8f-a919-0dddede4d9cf admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:56.372921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a48ac-43a9-4550-ae7a-4dae1dffa823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:56.374514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a48ac-43a9-4550-ae7a-4dae1dffa823 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:56.375031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a48ac-43a9-4550-ae7a-4dae1dffa823 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:56.376324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a48ac-43a9-4550-ae7a-4dae1dffa823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:56.390389 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a48ac-43a9-4550-ae7a-4dae1dffa823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:56.394864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a48ac-43a9-4550-ae7a-4dae1dffa823 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:56.407076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1070/2117] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:24:56.986698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3b27e-c4e0-4e04-a073-45e6e7c8ea57 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:56.988511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8af3b27e-c4e0-4e04-a073-45e6e7c8ea57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:57.002975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3b27e-c4e0-4e04-a073-45e6e7c8ea57 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:57.009303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:57.010687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:57.011059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:57.011406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] PATH_INFO: `/v3/projects/ded233008f6f467b84fb4399005c9b36` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:57.012697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded233008f6f467b84fb4399005c9b36)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:57.015074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:57.039587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:57.137971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded233008f6f467b84fb4399005c9b36', 'request_id': 'req-36efd3ec-0d16-4845-a782-9983c57deaba'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:57.146653 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded233008f6f467b84fb4399005c9b36', 'request_id': 'req-36efd3ec-0d16-4845-a782-9983c57deaba'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:57.213425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded233008f6f467b84fb4399005c9b36', 'request_id': 'req-36efd3ec-0d16-4845-a782-9983c57deaba'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:57.227735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] The token cache is being invalidate because project ded233008f6f467b84fb4399005c9b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:57.228030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:57.229066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-36efd3ec-0d16-4845-a782-9983c57deaba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:57.231277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1048/2118] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:56 2022] DELETE /identity/v3/projects/ded233008f6f467b84fb4399005c9b36 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:57.236888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffcb49-6673-4548-8c30-376da3fe40c5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:57.237386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffcb49-6673-4548-8c30-376da3fe40c5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:57.239858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffcb49-6673-4548-8c30-376da3fe40c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:57.261514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c5ffcb49-6673-4548-8c30-376da3fe40c5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:57.262811 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c5ffcb49-6673-4548-8c30-376da3fe40c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:57.347967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1071/2119] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:57.358332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a4919-5167-43f0-a79b-2e1ab188a87c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:57.358936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a4919-5167-43f0-a79b-2e1ab188a87c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:57.359360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a4919-5167-43f0-a79b-2e1ab188a87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:57.389093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-fc9a4919-5167-43f0-a79b-2e1ab188a87c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:57.394743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fc9a4919-5167-43f0-a79b-2e1ab188a87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:57.430233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1049/2120] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:57.436943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffcb49-6673-4548-8c30-376da3fe40c5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:57.453154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffcb49-6673-4548-8c30-376da3fe40c5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:57.462795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c3ef5-b8e0-4f01-9048-053fa7364a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:57.463977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3ef5-b8e0-4f01-9048-053fa7364a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:57.464422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3ef5-b8e0-4f01-9048-053fa7364a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:57.464856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3ef5-b8e0-4f01-9048-053fa7364a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:57.465877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c3ef5-b8e0-4f01-9048-053fa7364a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:24:57.466400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c3ef5-b8e0-4f01-9048-053fa7364a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:57.471881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a4919-5167-43f0-a79b-2e1ab188a87c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:57.473385 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fc9a4919-5167-43f0-a79b-2e1ab188a87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:57.473670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c3ef5-b8e0-4f01-9048-053fa7364a4e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:57.492497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1072/2121] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:24:57.495739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a4919-5167-43f0-a79b-2e1ab188a87c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:57.498704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c3ef5-b8e0-4f01-9048-053fa7364a4e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:57.501063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658dfd1-3e64-462a-9f12-dfcfb9c0bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:57.501748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658dfd1-3e64-462a-9f12-dfcfb9c0bdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:57.502189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658dfd1-3e64-462a-9f12-dfcfb9c0bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:57.502612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658dfd1-3e64-462a-9f12-dfcfb9c0bdc9 admin admin] PATH_INFO: `/v3/users/fd8d286577bb4f78b77d5c0e65389085` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:57.503972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658dfd1-3e64-462a-9f12-dfcfb9c0bdc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8d286577bb4f78b77d5c0e65389085)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:57.506804 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658dfd1-3e64-462a-9f12-dfcfb9c0bdc9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:57.512306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c3ef5-b8e0-4f01-9048-053fa7364a4e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:57.519914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae748b13-f3ee-43bd-bd60-1ef484922f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:57.521006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae748b13-f3ee-43bd-bd60-1ef484922f6e admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:57.521341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae748b13-f3ee-43bd-bd60-1ef484922f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:57.522887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae748b13-f3ee-43bd-bd60-1ef484922f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:57.524198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae748b13-f3ee-43bd-bd60-1ef484922f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:57.527230 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae748b13-f3ee-43bd-bd60-1ef484922f6e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:57.559244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:57.649907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1073/2122] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:57 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:57.655760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae748b13-f3ee-43bd-bd60-1ef484922f6e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:57.730175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9658dfd1-3e64-462a-9f12-dfcfb9c0bdc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8d286577bb4f78b77d5c0e65389085'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:57.732117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9658dfd1-3e64-462a-9f12-dfcfb9c0bdc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8d286577bb4f78b77d5c0e65389085'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:57.770760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9658dfd1-3e64-462a-9f12-dfcfb9c0bdc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8d286577bb4f78b77d5c0e65389085'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:57.801210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9658dfd1-3e64-462a-9f12-dfcfb9c0bdc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8d286577bb4f78b77d5c0e65389085'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:57.823704 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae748b13-f3ee-43bd-bd60-1ef484922f6e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:57.829051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380434c-83d1-4826-b08a-6c82623eef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:57.829953 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380434c-83d1-4826-b08a-6c82623eef5b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:57.830536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380434c-83d1-4826-b08a-6c82623eef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:57.831102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380434c-83d1-4826-b08a-6c82623eef5b admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:57.832033 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380434c-83d1-4826-b08a-6c82623eef5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:57.834955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380434c-83d1-4826-b08a-6c82623eef5b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:57.872397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9658dfd1-3e64-462a-9f12-dfcfb9c0bdc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8d286577bb4f78b77d5c0e65389085'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:57.892797 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1050/2123] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:57 2022] DELETE /identity/v3/users/fd8d286577bb4f78b77d5c0e65389085 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:57.903371 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf779d-3a92-4a26-96b9-ec58c6a8910d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:57.903586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf779d-3a92-4a26-96b9-ec58c6a8910d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:57.903872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf779d-3a92-4a26-96b9-ec58c6a8910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:57.932910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1074/2124] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:57 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:57.934043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-13bf779d-3a92-4a26-96b9-ec58c6a8910d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:57.934192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380434c-83d1-4826-b08a-6c82623eef5b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:57.935558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-13bf779d-3a92-4a26-96b9-ec58c6a8910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:57.937917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6380434c-83d1-4826-b08a-6c82623eef5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:57.960215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380434c-83d1-4826-b08a-6c82623eef5b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:58.044945 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1051/2125] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:58.064094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2b5a8-b024-4fd7-adc3-928b02fbbd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:58.065193 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2b5a8-b024-4fd7-adc3-928b02fbbd24 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:58.065610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2b5a8-b024-4fd7-adc3-928b02fbbd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:58.066056 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2b5a8-b024-4fd7-adc3-928b02fbbd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:58.067472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2b5a8-b024-4fd7-adc3-928b02fbbd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:58.069983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2b5a8-b024-4fd7-adc3-928b02fbbd24 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:58.075286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf779d-3a92-4a26-96b9-ec58c6a8910d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:58.077392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-13bf779d-3a92-4a26-96b9-ec58c6a8910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:58.095087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:58.099942 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1075/2126] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:58.105906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2b5a8-b024-4fd7-adc3-928b02fbbd24 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:58.124444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2b5a8-b024-4fd7-adc3-928b02fbbd24 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:58.138093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b34ff2-e86c-4528-a3ce-21dac59bb207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:58.138729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34ff2-e86c-4528-a3ce-21dac59bb207 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:58.139342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34ff2-e86c-4528-a3ce-21dac59bb207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:58.139342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34ff2-e86c-4528-a3ce-21dac59bb207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:58.139882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b34ff2-e86c-4528-a3ce-21dac59bb207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:58.141701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b34ff2-e86c-4528-a3ce-21dac59bb207 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:58.170045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1076/2127] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:58.171835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b34ff2-e86c-4528-a3ce-21dac59bb207 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:58.185197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b34ff2-e86c-4528-a3ce-21dac59bb207 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:58.191525 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf779d-3a92-4a26-96b9-ec58c6a8910d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:58.193414 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6b027-ae9f-4119-a108-13604fbca160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:58.195632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6b027-ae9f-4119-a108-13604fbca160 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:58.196154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6b027-ae9f-4119-a108-13604fbca160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:58.196580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6b027-ae9f-4119-a108-13604fbca160 admin admin] PATH_INFO: `/v3/projects/4d993ddd81bd43f796b67786285186f9/users/e5368bcffad548ec874a21161d0e49c0/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:58.205048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdea595-b3ed-4692-9a8a-5abfc0afb10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:58.205707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdea595-b3ed-4692-9a8a-5abfc0afb10d service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:58.205978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdea595-b3ed-4692-9a8a-5abfc0afb10d service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:58.206242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdea595-b3ed-4692-9a8a-5abfc0afb10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:58.218440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdea595-b3ed-4692-9a8a-5abfc0afb10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:58.220314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdea595-b3ed-4692-9a8a-5abfc0afb10d service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:58.238554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6b027-ae9f-4119-a108-13604fbca160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d993ddd81bd43f796b67786285186f9, user_id=e5368bcffad548ec874a21161d0e49c0, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:58.242511 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6b027-ae9f-4119-a108-13604fbca160 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:58.247463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1052/2128] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:58.260202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdea595-b3ed-4692-9a8a-5abfc0afb10d service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:58.262611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4cdea595-b3ed-4692-9a8a-5abfc0afb10d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:58.276339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdea595-b3ed-4692-9a8a-5abfc0afb10d service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:58.281552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad8f66-f917-4cc8-b0c7-681621660697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:58.294983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8f66-f917-4cc8-b0c7-681621660697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:58.295270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8f66-f917-4cc8-b0c7-681621660697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:58.295544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8f66-f917-4cc8-b0c7-681621660697 admin admin] PATH_INFO: `/v3/users/6d4c17658647480ab4e9a77b3c6f9462` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:58.297979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad8f66-f917-4cc8-b0c7-681621660697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4c17658647480ab4e9a77b3c6f9462)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:58.299927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad8f66-f917-4cc8-b0c7-681621660697 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:58.312259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1077/2129] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:58 2022] PUT /identity/v3/projects/4d993ddd81bd43f796b67786285186f9/users/e5368bcffad548ec874a21161d0e49c0/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:58.326430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5457e5-5252-4eed-9942-b3b26e651808 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:58.327083 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5457e5-5252-4eed-9942-b3b26e651808 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:58.327772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5457e5-5252-4eed-9942-b3b26e651808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:58.388162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-aa5457e5-5252-4eed-9942-b3b26e651808 None None] MFA Rules not processed for user `e5368bcffad548ec874a21161d0e49c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:58.392807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aa5457e5-5252-4eed-9942-b3b26e651808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:58.428422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:58.467634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1078/2130] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:58.472075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5457e5-5252-4eed-9942-b3b26e651808 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:58.551825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5457e5-5252-4eed-9942-b3b26e651808 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:58.556604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d5ad8f66-f917-4cc8-b0c7-681621660697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4c17658647480ab4e9a77b3c6f9462'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:58.557587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d5ad8f66-f917-4cc8-b0c7-681621660697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4c17658647480ab4e9a77b3c6f9462'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:58.557797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979370c-eee5-4c4a-8072-a64ee2454b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:58.558444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979370c-eee5-4c4a-8072-a64ee2454b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:58.558720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979370c-eee5-4c4a-8072-a64ee2454b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:58.559005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979370c-eee5-4c4a-8072-a64ee2454b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:58.559618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979370c-eee5-4c4a-8072-a64ee2454b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:58.561731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979370c-eee5-4c4a-8072-a64ee2454b88 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:58.570488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d5ad8f66-f917-4cc8-b0c7-681621660697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4c17658647480ab4e9a77b3c6f9462'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:58.582302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d5ad8f66-f917-4cc8-b0c7-681621660697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4c17658647480ab4e9a77b3c6f9462'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:58.672743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d5ad8f66-f917-4cc8-b0c7-681621660697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4c17658647480ab4e9a77b3c6f9462'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:58.679098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1079/2131] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:24:58 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:24:58.702535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1053/2132] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:58 2022] DELETE /identity/v3/users/6d4c17658647480ab4e9a77b3c6f9462 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:58.707399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251f3e-7445-41e1-9376-c79197774eda None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:58.707976 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979370c-eee5-4c4a-8072-a64ee2454b88 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:58.708764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251f3e-7445-41e1-9376-c79197774eda None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:58.711596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251f3e-7445-41e1-9376-c79197774eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:58.714223 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a979370c-eee5-4c4a-8072-a64ee2454b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:58.774227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c7251f3e-7445-41e1-9376-c79197774eda None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:58.774522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c7251f3e-7445-41e1-9376-c79197774eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:58.820533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979370c-eee5-4c4a-8072-a64ee2454b88 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:58.923679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa097-e80e-419f-b61d-7a9aad0992c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:58.924769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa097-e80e-419f-b61d-7a9aad0992c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:58.925176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa097-e80e-419f-b61d-7a9aad0992c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:58.925550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa097-e80e-419f-b61d-7a9aad0992c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:58.926720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa097-e80e-419f-b61d-7a9aad0992c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:58.929735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa097-e80e-419f-b61d-7a9aad0992c6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:58.935466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1054/2133] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:58.947286 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:58.947657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7251f3e-7445-41e1-9376-c79197774eda None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:58.950691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c7251f3e-7445-41e1-9376-c79197774eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:58.989534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:59.021454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1080/2134] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:24:58 2022] POST /identity/v3/users => generated 294 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:24:59.022849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa097-e80e-419f-b61d-7a9aad0992c6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:59.025880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e33fa097-e80e-419f-b61d-7a9aad0992c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:59.029483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7251f3e-7445-41e1-9376-c79197774eda None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:59.033436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353fb5a-60df-44c8-9fa8-60ac81207ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:59.034323 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353fb5a-60df-44c8-9fa8-60ac81207ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:59.034610 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353fb5a-60df-44c8-9fa8-60ac81207ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:59.034880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353fb5a-60df-44c8-9fa8-60ac81207ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:59.040883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa097-e80e-419f-b61d-7a9aad0992c6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:59.045576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353fb5a-60df-44c8-9fa8-60ac81207ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:59.046449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:59.047099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:59.047209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353fb5a-60df-44c8-9fa8-60ac81207ec0 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:59.047370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:59.047648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] PATH_INFO: `/v3/projects/47940166bdd0499e87f73e18210d40d5` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:59.048798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47940166bdd0499e87f73e18210d40d5)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:59.050767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:59.069716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1055/2135] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:59.071681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353fb5a-60df-44c8-9fa8-60ac81207ec0 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:59.090701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353fb5a-60df-44c8-9fa8-60ac81207ec0 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:59.098583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07dfd9-31fe-43af-b560-96ceba646889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:59.099296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07dfd9-31fe-43af-b560-96ceba646889 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:59.099485 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07dfd9-31fe-43af-b560-96ceba646889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:59.099748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07dfd9-31fe-43af-b560-96ceba646889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:59.101383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07dfd9-31fe-43af-b560-96ceba646889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:59.103071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07dfd9-31fe-43af-b560-96ceba646889 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:59.114535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1056/2136] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:24:59.125583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07dfd9-31fe-43af-b560-96ceba646889 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:59.139346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07dfd9-31fe-43af-b560-96ceba646889 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:59.145256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20952122-cdfe-4913-9701-65e44af044ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:59.145933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20952122-cdfe-4913-9701-65e44af044ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:59.146179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20952122-cdfe-4913-9701-65e44af044ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:59.146456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20952122-cdfe-4913-9701-65e44af044ca admin admin] PATH_INFO: `/v3/projects/e3474352a052427ca98f9b8828781f01/users/a6237a65ed294cd89bc75fa90596fbfe/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:59.173049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20952122-cdfe-4913-9701-65e44af044ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3474352a052427ca98f9b8828781f01, user_id=a6237a65ed294cd89bc75fa90596fbfe, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:59.175988 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20952122-cdfe-4913-9701-65e44af044ca admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:59.191388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47940166bdd0499e87f73e18210d40d5', 'request_id': 'req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:59.197693 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47940166bdd0499e87f73e18210d40d5', 'request_id': 'req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:59.205163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47940166bdd0499e87f73e18210d40d5', 'request_id': 'req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:59.257997 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1057/2137] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:59 2022] PUT /identity/v3/projects/e3474352a052427ca98f9b8828781f01/users/a6237a65ed294cd89bc75fa90596fbfe/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:59.259277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20952122-cdfe-4913-9701-65e44af044ca admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:59.289891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] The token cache is being invalidate because project 47940166bdd0499e87f73e18210d40d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:59.291841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:59.298945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:59.301356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1081/2138] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:59 2022] DELETE /identity/v3/projects/47940166bdd0499e87f73e18210d40d5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:59.307321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:59.312020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:59.392239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20952122-cdfe-4913-9701-65e44af044ca admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:59.398593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d730b1-61a0-4ca4-b6ba-972f2dc44a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:59.399394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d730b1-61a0-4ca4-b6ba-972f2dc44a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:59.399743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d730b1-61a0-4ca4-b6ba-972f2dc44a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:59.400069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d730b1-61a0-4ca4-b6ba-972f2dc44a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:59.400732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d730b1-61a0-4ca4-b6ba-972f2dc44a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:59.402393 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d730b1-61a0-4ca4-b6ba-972f2dc44a60 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:59.410521 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb2c1e-95b7-4a34-b918-2c359bbe45e3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:59.416220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:59.416954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1058/2139] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:24:59.417164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:59.417506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:59.417876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] PATH_INFO: `/v3/users/292c331daa4e4b57a2b55b127c2874d0` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:59.419242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=292c331daa4e4b57a2b55b127c2874d0)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:59.421128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d730b1-61a0-4ca4-b6ba-972f2dc44a60 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:59.421744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:59.423117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-86d730b1-61a0-4ca4-b6ba-972f2dc44a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:59.438504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d730b1-61a0-4ca4-b6ba-972f2dc44a60 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:59.445250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c7c9d-6419-4163-ab80-849185c8f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:59.446075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c7c9d-6419-4163-ab80-849185c8f241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:59.446362 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c7c9d-6419-4163-ab80-849185c8f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:59.446636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c7c9d-6419-4163-ab80-849185c8f241 admin admin] PATH_INFO: `/v3/projects/e3474352a052427ca98f9b8828781f01/users/a6237a65ed294cd89bc75fa90596fbfe/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:59.448614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c7c9d-6419-4163-ab80-849185c8f241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3474352a052427ca98f9b8828781f01, user_id=a6237a65ed294cd89bc75fa90596fbfe, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:59.451353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c7c9d-6419-4163-ab80-849185c8f241 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:59.464393 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1059/2140] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:24:59 2022] PUT /identity/v3/projects/e3474352a052427ca98f9b8828781f01/users/a6237a65ed294cd89bc75fa90596fbfe/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:59.474579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cebcc1-1bcd-46b5-b452-eb590acb68a8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:59.475491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cebcc1-1bcd-46b5-b452-eb590acb68a8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:59.476214 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cebcc1-1bcd-46b5-b452-eb590acb68a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:59.508623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-18cebcc1-1bcd-46b5-b452-eb590acb68a8 None None] MFA Rules not processed for user `a6237a65ed294cd89bc75fa90596fbfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:59.510328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-18cebcc1-1bcd-46b5-b452-eb590acb68a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:59.667501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292c331daa4e4b57a2b55b127c2874d0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:59.670099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292c331daa4e4b57a2b55b127c2874d0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:59.674662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1060/2141] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:59.688021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cebcc1-1bcd-46b5-b452-eb590acb68a8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:59.690076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-18cebcc1-1bcd-46b5-b452-eb590acb68a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:59.710155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292c331daa4e4b57a2b55b127c2874d0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:59.729265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292c331daa4e4b57a2b55b127c2874d0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:59.734091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292c331daa4e4b57a2b55b127c2874d0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:59.741921 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=4,keystone:SELECT=80,keystone:DELETE=16 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:59.821752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1082/2142] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:59 2022] DELETE /identity/v3/users/292c331daa4e4b57a2b55b127c2874d0 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:59.853798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cebcc1-1bcd-46b5-b452-eb590acb68a8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:59.936875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab6125-ebd5-43f0-abd4-0ca047977d16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:59.937631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6125-ebd5-43f0-abd4-0ca047977d16 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:59.938054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6125-ebd5-43f0-abd4-0ca047977d16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:59.938425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab6125-ebd5-43f0-abd4-0ca047977d16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:59.940934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cdab6125-ebd5-43f0-abd4-0ca047977d16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:00.050289 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab6125-ebd5-43f0-abd4-0ca047977d16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:00.052151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab6125-ebd5-43f0-abd4-0ca047977d16 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:00.065625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1061/2143] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:00.097961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:00.099425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:00.220472 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:00.319386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80e9fa-3de6-4618-988a-0f8f238a61a2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:00.325244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:00.325967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:00.326247 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:00.326522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] PATH_INFO: `/v3/projects/f7c9a5af35134001a6a9a1933ee883cd` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:00.328237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c9a5af35134001a6a9a1933ee883cd)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:00.330734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:00.403848 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580261b-bcf6-457c-9898-6e48dba3f039 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:00.404767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580261b-bcf6-457c-9898-6e48dba3f039 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:00.405051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580261b-bcf6-457c-9898-6e48dba3f039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:00.438078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c580261b-bcf6-457c-9898-6e48dba3f039 None None] MFA Rules not processed for user `07b2fcfa197e4e93852c9a04aa8f008a`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:00.439436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c580261b-bcf6-457c-9898-6e48dba3f039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:00.527244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1062/2144] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:00.539420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cad0a-2897-4304-9ae1-38a03734ac6b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:00.539794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cad0a-2897-4304-9ae1-38a03734ac6b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:00.540189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cad0a-2897-4304-9ae1-38a03734ac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:00.541253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c9a5af35134001a6a9a1933ee883cd', 'request_id': 'req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:00.550648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c9a5af35134001a6a9a1933ee883cd', 'request_id': 'req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:00.558204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c9a5af35134001a6a9a1933ee883cd', 'request_id': 'req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:00.562020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a45cad0a-2897-4304-9ae1-38a03734ac6b None None] MFA Rules not processed for user `07b2fcfa197e4e93852c9a04aa8f008a`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:00.566134 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a45cad0a-2897-4304-9ae1-38a03734ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:00.665719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1063/2145] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:00.671399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cad0a-2897-4304-9ae1-38a03734ac6b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:00.672856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a45cad0a-2897-4304-9ae1-38a03734ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:00.687228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] The token cache is being invalidate because project f7c9a5af35134001a6a9a1933ee883cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:00.687612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:00.688500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:00.697123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1083/2146] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:00 2022] DELETE /identity/v3/projects/f7c9a5af35134001a6a9a1933ee883cd => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:00.698313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:00.700824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:00.776184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cad0a-2897-4304-9ae1-38a03734ac6b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:00.782404 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:00.783110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:00.783464 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:00.784131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] PATH_INFO: `/v3/projects/dc88a37666544cfab3fff4d9760a67bb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:00.785551 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc88a37666544cfab3fff4d9760a67bb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:00.789079 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:00.818413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b988a4-8ab8-44b3-b57d-0f8191dcd77b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:00.824380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3860-1232-43fa-b759-c14d2cf3847c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:00.825189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3860-1232-43fa-b759-c14d2cf3847c service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:00.825510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3860-1232-43fa-b759-c14d2cf3847c service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:00.826873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3860-1232-43fa-b759-c14d2cf3847c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:00.828918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ac2f3860-1232-43fa-b759-c14d2cf3847c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:00.842703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f3860-1232-43fa-b759-c14d2cf3847c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:00.856012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f3860-1232-43fa-b759-c14d2cf3847c service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:00.866261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1084/2147] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:00.869452 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3860-1232-43fa-b759-c14d2cf3847c service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:00.871222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ac2f3860-1232-43fa-b759-c14d2cf3847c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:00.901263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3860-1232-43fa-b759-c14d2cf3847c service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:00.907566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396dfc7-22ec-45cd-b75b-c957c16dd59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:00.908118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396dfc7-22ec-45cd-b75b-c957c16dd59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:00.909175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396dfc7-22ec-45cd-b75b-c957c16dd59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:00.909175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396dfc7-22ec-45cd-b75b-c957c16dd59e admin admin] PATH_INFO: `/v3/users/592cd69cfb0b4096b21f1ccebbdd476c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:00.910128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396dfc7-22ec-45cd-b75b-c957c16dd59e admin admin] RBAC: Authorizing `identity:delete_user(user_id=592cd69cfb0b4096b21f1ccebbdd476c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:00.912262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396dfc7-22ec-45cd-b75b-c957c16dd59e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:00.915783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:00.952004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc88a37666544cfab3fff4d9760a67bb', 'request_id': 'req-0022a67c-23ca-4f9b-abdc-7d74f5424408'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:00.964397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc88a37666544cfab3fff4d9760a67bb', 'request_id': 'req-0022a67c-23ca-4f9b-abdc-7d74f5424408'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.055067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc88a37666544cfab3fff4d9760a67bb', 'request_id': 'req-0022a67c-23ca-4f9b-abdc-7d74f5424408'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.075010 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] The token cache is being invalidate because project dc88a37666544cfab3fff4d9760a67bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:01.075457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.076401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.081530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1064/2148] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:00 2022] DELETE /identity/v3/projects/dc88a37666544cfab3fff4d9760a67bb => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:01.083360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:01.086782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:01.089402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:01.159634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6396dfc7-22ec-45cd-b75b-c957c16dd59e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592cd69cfb0b4096b21f1ccebbdd476c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.160428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6396dfc7-22ec-45cd-b75b-c957c16dd59e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592cd69cfb0b4096b21f1ccebbdd476c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.185488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6396dfc7-22ec-45cd-b75b-c957c16dd59e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592cd69cfb0b4096b21f1ccebbdd476c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.196277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6396dfc7-22ec-45cd-b75b-c957c16dd59e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592cd69cfb0b4096b21f1ccebbdd476c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.197292 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6396dfc7-22ec-45cd-b75b-c957c16dd59e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592cd69cfb0b4096b21f1ccebbdd476c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.218140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a67c-23ca-4f9b-abdc-7d74f5424408 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:01.223273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:01.223907 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:01.224181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:01.224451 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] PATH_INFO: `/v3/users/d5b484f790ad4254884dfd5057147ac6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:01.226940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b484f790ad4254884dfd5057147ac6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:01.228993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:01.324383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1085/2149] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:00 2022] DELETE /identity/v3/users/592cd69cfb0b4096b21f1ccebbdd476c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:01.437108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b484f790ad4254884dfd5057147ac6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.437977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b484f790ad4254884dfd5057147ac6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.446152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b484f790ad4254884dfd5057147ac6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.458603 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b484f790ad4254884dfd5057147ac6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.523002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b484f790ad4254884dfd5057147ac6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:01.533993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1065/2150] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:01 2022] DELETE /identity/v3/users/d5b484f790ad4254884dfd5057147ac6 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:01.699778 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2001-8983-4072-89a5-9f3f67a08297 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:01.700227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2001-8983-4072-89a5-9f3f67a08297 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:01.700647 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2001-8983-4072-89a5-9f3f67a08297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:01.717723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:01.726773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8abd2001-8983-4072-89a5-9f3f67a08297 None None] MFA Rules not processed for user `07b2fcfa197e4e93852c9a04aa8f008a`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:01.728066 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8abd2001-8983-4072-89a5-9f3f67a08297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:01.828393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1086/2151] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:01.904348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:01.907355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:02.079134 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d3ffe-60b3-4b0d-8726-1d0100e13a09 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:02.088809 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:02.089498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:02.089800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:02.090047 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] PATH_INFO: `/v3/projects/821a9fcdf4874229880e56e72f4007e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:02.092669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=821a9fcdf4874229880e56e72f4007e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:02.094803 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:02.103690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd2001-8983-4072-89a5-9f3f67a08297 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:02.105143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8abd2001-8983-4072-89a5-9f3f67a08297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:02.130807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd2001-8983-4072-89a5-9f3f67a08297 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:02.156096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:02.156759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:02.157033 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:02.157303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] PATH_INFO: `/v3/projects/829b6b87b08849379d38ea77f5977080` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:02.160803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829b6b87b08849379d38ea77f5977080)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:02.165700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:02.311060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '821a9fcdf4874229880e56e72f4007e6', 'request_id': 'req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:02.318853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '821a9fcdf4874229880e56e72f4007e6', 'request_id': 'req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:02.386165 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '821a9fcdf4874229880e56e72f4007e6', 'request_id': 'req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:02.403579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] The token cache is being invalidate because project 821a9fcdf4874229880e56e72f4007e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:02.405223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:02.406517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fb1fb3d2-71ea-40a4-87e2-e46fd95c3ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:02.415279 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1066/2152] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:01 2022] DELETE /identity/v3/projects/821a9fcdf4874229880e56e72f4007e6 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:02.418529 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829b6b87b08849379d38ea77f5977080', 'request_id': 'req-0e0d9103-c505-4030-b24e-7e7b54f45767'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:02.418996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79188a02-39ec-4d6e-8d70-49e2901c3bfe None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:02.419356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79188a02-39ec-4d6e-8d70-49e2901c3bfe None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:02.420481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79188a02-39ec-4d6e-8d70-49e2901c3bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:02.435499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829b6b87b08849379d38ea77f5977080', 'request_id': 'req-0e0d9103-c505-4030-b24e-7e7b54f45767'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:02.452868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829b6b87b08849379d38ea77f5977080', 'request_id': 'req-0e0d9103-c505-4030-b24e-7e7b54f45767'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:02.467015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-79188a02-39ec-4d6e-8d70-49e2901c3bfe None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:02.471365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-79188a02-39ec-4d6e-8d70-49e2901c3bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:02.554026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] The token cache is being invalidate because project 829b6b87b08849379d38ea77f5977080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:02.556352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:02.556352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0e0d9103-c505-4030-b24e-7e7b54f45767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:02.559002 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1087/2153] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:02 2022] DELETE /identity/v3/projects/829b6b87b08849379d38ea77f5977080 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:02.616149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1067/2154] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:02.626451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d92ed-c773-48d2-9acd-5b11fab5b337 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:02.626748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d92ed-c773-48d2-9acd-5b11fab5b337 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:02.627046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d92ed-c773-48d2-9acd-5b11fab5b337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:02.654766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9f7d92ed-c773-48d2-9acd-5b11fab5b337 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:02.656534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9f7d92ed-c773-48d2-9acd-5b11fab5b337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:02.681086 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1088/2155] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:02.685408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79188a02-39ec-4d6e-8d70-49e2901c3bfe None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:02.698688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79188a02-39ec-4d6e-8d70-49e2901c3bfe None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:02.704052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddefc0a-15d2-4b47-b9ce-bc31d80c81ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:02.704913 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddefc0a-15d2-4b47-b9ce-bc31d80c81ac admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:02.705231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddefc0a-15d2-4b47-b9ce-bc31d80c81ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:02.705507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddefc0a-15d2-4b47-b9ce-bc31d80c81ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:02.706523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddefc0a-15d2-4b47-b9ce-bc31d80c81ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:25:02.706885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddefc0a-15d2-4b47-b9ce-bc31d80c81ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:02.709003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddefc0a-15d2-4b47-b9ce-bc31d80c81ac admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:02.738596 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1068/2156] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:25:02.743348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d92ed-c773-48d2-9acd-5b11fab5b337 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:02.758098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d92ed-c773-48d2-9acd-5b11fab5b337 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:02.768146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34048d1b-8c79-4cc4-ac68-2ad42930c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:02.770736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34048d1b-8c79-4cc4-ac68-2ad42930c986 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:02.771200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34048d1b-8c79-4cc4-ac68-2ad42930c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:02.773263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34048d1b-8c79-4cc4-ac68-2ad42930c986 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:02.774518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34048d1b-8c79-4cc4-ac68-2ad42930c986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:02.778728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34048d1b-8c79-4cc4-ac68-2ad42930c986 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:02.924186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:02.934863 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1089/2157] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:02 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:02.936114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddefc0a-15d2-4b47-b9ce-bc31d80c81ac admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:02.947023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddefc0a-15d2-4b47-b9ce-bc31d80c81ac admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:03.010716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf3464-ec5e-4684-a8b3-c4c4d15e92d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:03.011363 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf3464-ec5e-4684-a8b3-c4c4d15e92d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:03.014194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf3464-ec5e-4684-a8b3-c4c4d15e92d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:03.014194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf3464-ec5e-4684-a8b3-c4c4d15e92d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:03.014194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf3464-ec5e-4684-a8b3-c4c4d15e92d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:03.014441 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf3464-ec5e-4684-a8b3-c4c4d15e92d9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:03.159192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1069/2158] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:25:02 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:03.160614 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34048d1b-8c79-4cc4-ac68-2ad42930c986 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:03.171412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34048d1b-8c79-4cc4-ac68-2ad42930c986 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:03.181631 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524a374-677b-45af-8bda-41d23052d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:03.182323 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524a374-677b-45af-8bda-41d23052d2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:03.182784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524a374-677b-45af-8bda-41d23052d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:03.183053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524a374-677b-45af-8bda-41d23052d2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:03.183793 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524a374-677b-45af-8bda-41d23052d2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:03.185602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524a374-677b-45af-8bda-41d23052d2d5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:03.209038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1090/2159] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:25:03.213670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf3464-ec5e-4684-a8b3-c4c4d15e92d9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:03.223740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf3464-ec5e-4684-a8b3-c4c4d15e92d9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:03.228558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0bf57-98d5-42c0-af4a-8aab775d5785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:03.229158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0bf57-98d5-42c0-af4a-8aab775d5785 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:03.229473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0bf57-98d5-42c0-af4a-8aab775d5785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:03.229750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0bf57-98d5-42c0-af4a-8aab775d5785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:03.230391 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0bf57-98d5-42c0-af4a-8aab775d5785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:03.231978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0bf57-98d5-42c0-af4a-8aab775d5785 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:03.243964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1070/2160] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:03.249406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524a374-677b-45af-8bda-41d23052d2d5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:03.260752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524a374-677b-45af-8bda-41d23052d2d5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:03.265412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c833358-952f-4483-a2b0-a39a2e42bb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:03.266075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c833358-952f-4483-a2b0-a39a2e42bb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:03.266567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c833358-952f-4483-a2b0-a39a2e42bb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:03.266861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c833358-952f-4483-a2b0-a39a2e42bb65 admin admin] PATH_INFO: `/v3/projects/6018104d791f4a5086bacbe43864b2a6/users/e480b048e1044002825d9c4c2a107284/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:03.284177 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c833358-952f-4483-a2b0-a39a2e42bb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6018104d791f4a5086bacbe43864b2a6, user_id=e480b048e1044002825d9c4c2a107284, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:03.287199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c833358-952f-4483-a2b0-a39a2e42bb65 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:03.381633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1091/2161] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:03 2022] PUT /identity/v3/projects/6018104d791f4a5086bacbe43864b2a6/users/e480b048e1044002825d9c4c2a107284/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:03.391881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2d00-903a-473c-aa48-3d84f4149893 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:03.392178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2d00-903a-473c-aa48-3d84f4149893 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:03.392453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2d00-903a-473c-aa48-3d84f4149893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:03.422736 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-53ed2d00-903a-473c-aa48-3d84f4149893 None None] MFA Rules not processed for user `e480b048e1044002825d9c4c2a107284`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:03.424020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-53ed2d00-903a-473c-aa48-3d84f4149893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:03.494805 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1071/2162] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:03.499056 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c833358-952f-4483-a2b0-a39a2e42bb65 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:03.581040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c833358-952f-4483-a2b0-a39a2e42bb65 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:03.590869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f2f2c-ea40-4943-9e6a-4456e9fc3777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:03.591512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f2f2c-ea40-4943-9e6a-4456e9fc3777 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:03.591781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f2f2c-ea40-4943-9e6a-4456e9fc3777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:03.592056 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f2f2c-ea40-4943-9e6a-4456e9fc3777 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:03.592841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f2f2c-ea40-4943-9e6a-4456e9fc3777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:03.594833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f2f2c-ea40-4943-9e6a-4456e9fc3777 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:03.640166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed2d00-903a-473c-aa48-3d84f4149893 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:03.641672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-53ed2d00-903a-473c-aa48-3d84f4149893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:03.664091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed2d00-903a-473c-aa48-3d84f4149893 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:03.671201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0563e7-6507-4a24-961e-fcc02b91c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:03.672079 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0563e7-6507-4a24-961e-fcc02b91c982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:03.672527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0563e7-6507-4a24-961e-fcc02b91c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:03.672952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0563e7-6507-4a24-961e-fcc02b91c982 admin admin] PATH_INFO: `/v3/users/e5368bcffad548ec874a21161d0e49c0` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:03.675031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0563e7-6507-4a24-961e-fcc02b91c982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5368bcffad548ec874a21161d0e49c0)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:03.677143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0563e7-6507-4a24-961e-fcc02b91c982 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:03.704974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1092/2163] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:03 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:03.709588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f2f2c-ea40-4943-9e6a-4456e9fc3777 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:03.796723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f2f2c-ea40-4943-9e6a-4456e9fc3777 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:03.818147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc88c3-045a-48d8-811b-36a5ac257d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:03.819677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc88c3-045a-48d8-811b-36a5ac257d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:03.820035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc88c3-045a-48d8-811b-36a5ac257d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:03.820407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc88c3-045a-48d8-811b-36a5ac257d11 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:03.821053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc88c3-045a-48d8-811b-36a5ac257d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:03.824027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc88c3-045a-48d8-811b-36a5ac257d11 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:03.947381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1093/2164] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:25:03 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:25:03.953539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc88c3-045a-48d8-811b-36a5ac257d11 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:03.983507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc88c3-045a-48d8-811b-36a5ac257d11 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:03.998671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc4199-d952-49dc-aa00-8ffc72c450b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:04.005505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4199-d952-49dc-aa00-8ffc72c450b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:04.006675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4199-d952-49dc-aa00-8ffc72c450b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:04.007552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0f0563e7-6507-4a24-961e-fcc02b91c982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5368bcffad548ec874a21161d0e49c0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:04.009519 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0f0563e7-6507-4a24-961e-fcc02b91c982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5368bcffad548ec874a21161d0e49c0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:04.009917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4199-d952-49dc-aa00-8ffc72c450b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:04.010639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc4199-d952-49dc-aa00-8ffc72c450b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:04.013485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc4199-d952-49dc-aa00-8ffc72c450b8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:04.019106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0f0563e7-6507-4a24-961e-fcc02b91c982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5368bcffad548ec874a21161d0e49c0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:04.026010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1094/2165] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:25:04.030335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc4199-d952-49dc-aa00-8ffc72c450b8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:04.039544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0f0563e7-6507-4a24-961e-fcc02b91c982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5368bcffad548ec874a21161d0e49c0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:04.041889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc4199-d952-49dc-aa00-8ffc72c450b8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:04.048273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee56da-145c-443b-991a-889fb2206a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:04.048945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee56da-145c-443b-991a-889fb2206a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:04.049217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee56da-145c-443b-991a-889fb2206a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:04.049539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee56da-145c-443b-991a-889fb2206a87 admin admin] PATH_INFO: `/v3/projects/4341dd53604447e1b287a16ea4a4470f/users/3c54c066890e432ebfcf0b56b5528543/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:04.074932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee56da-145c-443b-991a-889fb2206a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4341dd53604447e1b287a16ea4a4470f, user_id=3c54c066890e432ebfcf0b56b5528543, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:04.077768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee56da-145c-443b-991a-889fb2206a87 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:04.156981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0f0563e7-6507-4a24-961e-fcc02b91c982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5368bcffad548ec874a21161d0e49c0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:04.168121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1072/2166] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:03 2022] DELETE /identity/v3/users/e5368bcffad548ec874a21161d0e49c0 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:04.172692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03695-7e2e-4fe9-97ed-237cac401a29 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:04.173185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03695-7e2e-4fe9-97ed-237cac401a29 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:04.173522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03695-7e2e-4fe9-97ed-237cac401a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:04.194640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1095/2167] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:04 2022] PUT /identity/v3/projects/4341dd53604447e1b287a16ea4a4470f/users/3c54c066890e432ebfcf0b56b5528543/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:25:04.197356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-38d03695-7e2e-4fe9-97ed-237cac401a29 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:04.198794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-38d03695-7e2e-4fe9-97ed-237cac401a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:04.200677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee56da-145c-443b-991a-889fb2206a87 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:04.203909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a0ee56da-145c-443b-991a-889fb2206a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:04.299382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1073/2168] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:25:04.303378 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee56da-145c-443b-991a-889fb2206a87 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:04.308239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e90a9-ce85-44f3-be29-3693235f63c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:04.312915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e90a9-ce85-44f3-be29-3693235f63c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:04.312915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e90a9-ce85-44f3-be29-3693235f63c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:04.312915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e90a9-ce85-44f3-be29-3693235f63c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:04.313178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d03695-7e2e-4fe9-97ed-237cac401a29 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:04.313286 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e90a9-ce85-44f3-be29-3693235f63c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:04.313526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-38d03695-7e2e-4fe9-97ed-237cac401a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:04.313616 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e90a9-ce85-44f3-be29-3693235f63c2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:04.324724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1096/2169] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:25:04.329355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e90a9-ce85-44f3-be29-3693235f63c2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:04.340241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e90a9-ce85-44f3-be29-3693235f63c2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:04.346956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0e9e6-0a8d-4bd0-8150-12be97ee6220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:04.347631 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0e9e6-0a8d-4bd0-8150-12be97ee6220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:04.349109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0e9e6-0a8d-4bd0-8150-12be97ee6220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:04.349109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0e9e6-0a8d-4bd0-8150-12be97ee6220 admin admin] PATH_INFO: `/v3/projects/4341dd53604447e1b287a16ea4a4470f/users/3c54c066890e432ebfcf0b56b5528543/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:04.350963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0e9e6-0a8d-4bd0-8150-12be97ee6220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4341dd53604447e1b287a16ea4a4470f, user_id=3c54c066890e432ebfcf0b56b5528543, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:04.353760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0e9e6-0a8d-4bd0-8150-12be97ee6220 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:04.364923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1097/2170] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:04 2022] PUT /identity/v3/projects/4341dd53604447e1b287a16ea4a4470f/users/3c54c066890e432ebfcf0b56b5528543/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:04.377357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eb35b-d422-46fe-afe1-0a8a790fb4d1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:04.377876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eb35b-d422-46fe-afe1-0a8a790fb4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:04.378165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eb35b-d422-46fe-afe1-0a8a790fb4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:04.384831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d03695-7e2e-4fe9-97ed-237cac401a29 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:04.412023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-721eb35b-d422-46fe-afe1-0a8a790fb4d1 None None] MFA Rules not processed for user `3c54c066890e432ebfcf0b56b5528543`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:04.413357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-721eb35b-d422-46fe-afe1-0a8a790fb4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:04.450726 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c042f-003d-4741-8da8-a71617fd744b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:04.451486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c042f-003d-4741-8da8-a71617fd744b service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:04.452243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c042f-003d-4741-8da8-a71617fd744b service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:04.452518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c042f-003d-4741-8da8-a71617fd744b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:04.488410 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1098/2171] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:25:04.500040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721eb35b-d422-46fe-afe1-0a8a790fb4d1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:04.503148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-721eb35b-d422-46fe-afe1-0a8a790fb4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:04.522286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c042f-003d-4741-8da8-a71617fd744b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:04.524045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c042f-003d-4741-8da8-a71617fd744b service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:04.534517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1074/2172] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:04.557244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:04.564734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721eb35b-d422-46fe-afe1-0a8a790fb4d1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:04.569511 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff67f-b1f5-4b84-b774-892f9585c953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:04.570337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff67f-b1f5-4b84-b774-892f9585c953 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:04.570613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff67f-b1f5-4b84-b774-892f9585c953 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:04.570885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff67f-b1f5-4b84-b774-892f9585c953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:04.581118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff67f-b1f5-4b84-b774-892f9585c953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:04.582776 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff67f-b1f5-4b84-b774-892f9585c953 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:04.594490 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1099/2173] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:25:04.895682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c042f-003d-4741-8da8-a71617fd744b service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:04.909757 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c042f-003d-4741-8da8-a71617fd744b service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:04.913575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2684e-f9ce-4a1e-b326-3f5704de802a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:04.914207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2684e-f9ce-4a1e-b326-3f5704de802a service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:04.914702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2684e-f9ce-4a1e-b326-3f5704de802a service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:04.914973 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2684e-f9ce-4a1e-b326-3f5704de802a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:04.916792 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-65b2684e-f9ce-4a1e-b326-3f5704de802a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:05.035501 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2684e-f9ce-4a1e-b326-3f5704de802a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:05.038161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2684e-f9ce-4a1e-b326-3f5704de802a service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:05.048119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1075/2174] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:05.121123 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff67f-b1f5-4b84-b774-892f9585c953 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:05.122755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fd3ff67f-b1f5-4b84-b774-892f9585c953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:05.148071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff67f-b1f5-4b84-b774-892f9585c953 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:05.160767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:05.161624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:05.162027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:05.181407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] PATH_INFO: `/v3/projects/4d993ddd81bd43f796b67786285186f9` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:05.188787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d993ddd81bd43f796b67786285186f9)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:05.198330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:05.326185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d993ddd81bd43f796b67786285186f9', 'request_id': 'req-8d065007-f87e-4c3c-9627-ac469512cb97'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:05.340188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d993ddd81bd43f796b67786285186f9', 'request_id': 'req-8d065007-f87e-4c3c-9627-ac469512cb97'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:05.347985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d993ddd81bd43f796b67786285186f9', 'request_id': 'req-8d065007-f87e-4c3c-9627-ac469512cb97'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:05.476869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] The token cache is being invalidate because project 4d993ddd81bd43f796b67786285186f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:05.477484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:05.478301 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:05.480299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1100/2175] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:05 2022] DELETE /identity/v3/projects/4d993ddd81bd43f796b67786285186f9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:05.484303 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2684e-f9ce-4a1e-b326-3f5704de802a service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:05.504495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2684e-f9ce-4a1e-b326-3f5704de802a service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:05.567744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7667e0-2013-488f-b469-b287369efe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:05.568985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7667e0-2013-488f-b469-b287369efe86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:05.569197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7667e0-2013-488f-b469-b287369efe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:05.569526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7667e0-2013-488f-b469-b287369efe86 admin admin] PATH_INFO: `/v3/users/a6237a65ed294cd89bc75fa90596fbfe` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:05.570654 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7667e0-2013-488f-b469-b287369efe86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6237a65ed294cd89bc75fa90596fbfe)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:05.572564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7667e0-2013-488f-b469-b287369efe86 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:05.739510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:05.811531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-be7667e0-2013-488f-b469-b287369efe86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6237a65ed294cd89bc75fa90596fbfe'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:05.812341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-be7667e0-2013-488f-b469-b287369efe86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6237a65ed294cd89bc75fa90596fbfe'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:05.819910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-be7667e0-2013-488f-b469-b287369efe86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6237a65ed294cd89bc75fa90596fbfe'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:05.832474 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-be7667e0-2013-488f-b469-b287369efe86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6237a65ed294cd89bc75fa90596fbfe'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:05.922441 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-be7667e0-2013-488f-b469-b287369efe86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6237a65ed294cd89bc75fa90596fbfe'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:05.931275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1076/2176] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:05 2022] DELETE /identity/v3/users/a6237a65ed294cd89bc75fa90596fbfe => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:06.422894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:06.424795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:06.470443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d065007-f87e-4c3c-9627-ac469512cb97 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:06.568035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:06.569405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:06.569688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:06.569964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] PATH_INFO: `/v3/projects/e3474352a052427ca98f9b8828781f01` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:06.571385 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3474352a052427ca98f9b8828781f01)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:06.579667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:06.748552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3474352a052427ca98f9b8828781f01', 'request_id': 'req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:06.754660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3474352a052427ca98f9b8828781f01', 'request_id': 'req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:06.757436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:06.770988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3474352a052427ca98f9b8828781f01', 'request_id': 'req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:06.856962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] The token cache is being invalidate because project e3474352a052427ca98f9b8828781f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:06.857281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:06.857992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b190ecd6-98b0-4ad0-bbd1-f2653e801b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:06.863206 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1101/2177] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:06 2022] DELETE /identity/v3/projects/e3474352a052427ca98f9b8828781f01 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:06.864932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b1af-e185-4f5c-bbb8-e8e33d9486cd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:06.865444 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b1af-e185-4f5c-bbb8-e8e33d9486cd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:06.865859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2b1af-e185-4f5c-bbb8-e8e33d9486cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:06.889624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2ee2b1af-e185-4f5c-bbb8-e8e33d9486cd None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:06.891768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2ee2b1af-e185-4f5c-bbb8-e8e33d9486cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:06.977248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1077/2178] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:06.979452 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:06.986279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd9f7-7a61-4cd9-8b51-cdcc1d344270 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:06.986657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd9f7-7a61-4cd9-8b51-cdcc1d344270 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:06.987028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd9f7-7a61-4cd9-8b51-cdcc1d344270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:07.022889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-83dcd9f7-7a61-4cd9-8b51-cdcc1d344270 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:07.024557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-83dcd9f7-7a61-4cd9-8b51-cdcc1d344270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:07.040218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1102/2179] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:07.044222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2b1af-e185-4f5c-bbb8-e8e33d9486cd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:07.055690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2b1af-e185-4f5c-bbb8-e8e33d9486cd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:07.062192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ace6eb-1b12-4ce1-961a-e07f7acab9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:07.063147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ace6eb-1b12-4ce1-961a-e07f7acab9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:07.063605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ace6eb-1b12-4ce1-961a-e07f7acab9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:07.063751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ace6eb-1b12-4ce1-961a-e07f7acab9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:07.064447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ace6eb-1b12-4ce1-961a-e07f7acab9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:25:07.064954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ace6eb-1b12-4ce1-961a-e07f7acab9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:07.066818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ace6eb-1b12-4ce1-961a-e07f7acab9e5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:07.085134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcd9f7-7a61-4cd9-8b51-cdcc1d344270 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:07.085474 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1078/2180] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:25:07.094307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcd9f7-7a61-4cd9-8b51-cdcc1d344270 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:07.099002 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a64932-cb40-4811-b851-85369c28bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:07.099896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a64932-cb40-4811-b851-85369c28bd17 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:07.100209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a64932-cb40-4811-b851-85369c28bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:07.100488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a64932-cb40-4811-b851-85369c28bd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:07.101108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a64932-cb40-4811-b851-85369c28bd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:07.103053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a64932-cb40-4811-b851-85369c28bd17 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:07.195906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1103/2181] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:07 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:07.197178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ace6eb-1b12-4ce1-961a-e07f7acab9e5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:07.211514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ace6eb-1b12-4ce1-961a-e07f7acab9e5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:07.283418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ad7f-f8c2-4d95-8078-bda3ff32dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:07.292030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ad7f-f8c2-4d95-8078-bda3ff32dd31 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:07.292030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ad7f-f8c2-4d95-8078-bda3ff32dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:07.292030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ad7f-f8c2-4d95-8078-bda3ff32dd31 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:07.292030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998ad7f-f8c2-4d95-8078-bda3ff32dd31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:07.292030 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998ad7f-f8c2-4d95-8078-bda3ff32dd31 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:07.417700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1079/2182] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:25:07 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:25:07.419578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a64932-cb40-4811-b851-85369c28bd17 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:07.430660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a64932-cb40-4811-b851-85369c28bd17 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:07.436729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb24cc-d6e3-4d81-8768-4335fe13a697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:07.437349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb24cc-d6e3-4d81-8768-4335fe13a697 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:07.438023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb24cc-d6e3-4d81-8768-4335fe13a697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:07.438651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb24cc-d6e3-4d81-8768-4335fe13a697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:07.439732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb24cc-d6e3-4d81-8768-4335fe13a697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:07.442414 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb24cc-d6e3-4d81-8768-4335fe13a697 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:07.456926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1104/2183] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:07.458192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ad7f-f8c2-4d95-8078-bda3ff32dd31 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:07.468124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ad7f-f8c2-4d95-8078-bda3ff32dd31 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:07.472810 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb508ac-b588-44ad-9c96-1ab8c957b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:07.473441 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb508ac-b588-44ad-9c96-1ab8c957b397 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:07.473718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb508ac-b588-44ad-9c96-1ab8c957b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:07.473986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb508ac-b588-44ad-9c96-1ab8c957b397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:07.475199 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb508ac-b588-44ad-9c96-1ab8c957b397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:07.476791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb508ac-b588-44ad-9c96-1ab8c957b397 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:07.488910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1080/2184] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:25:07.494060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb24cc-d6e3-4d81-8768-4335fe13a697 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:07.503893 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb24cc-d6e3-4d81-8768-4335fe13a697 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:07.508950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb283e-19fd-4a53-a088-23c114cd1da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:07.509645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb283e-19fd-4a53-a088-23c114cd1da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:07.509916 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb283e-19fd-4a53-a088-23c114cd1da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:07.510373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb283e-19fd-4a53-a088-23c114cd1da1 admin admin] PATH_INFO: `/v3/projects/0368f88625bf49c381e1ef9003812354/users/c3464154f794432c82912d6ef82dd77d/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:07.530925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb283e-19fd-4a53-a088-23c114cd1da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0368f88625bf49c381e1ef9003812354, user_id=c3464154f794432c82912d6ef82dd77d, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:07.536347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb283e-19fd-4a53-a088-23c114cd1da1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:07.591990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1105/2185] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:07 2022] PUT /identity/v3/projects/0368f88625bf49c381e1ef9003812354/users/c3464154f794432c82912d6ef82dd77d/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:25:07.603104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73fc67-c9ac-4652-a45a-1ecd60741cde None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:07.603393 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73fc67-c9ac-4652-a45a-1ecd60741cde None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:07.603664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73fc67-c9ac-4652-a45a-1ecd60741cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:07.633011 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-aa73fc67-c9ac-4652-a45a-1ecd60741cde None None] MFA Rules not processed for user `c3464154f794432c82912d6ef82dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:07.634309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-aa73fc67-c9ac-4652-a45a-1ecd60741cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:07.723455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1081/2186] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:25:07.732574 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb283e-19fd-4a53-a088-23c114cd1da1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:07.734806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c7bb283e-19fd-4a53-a088-23c114cd1da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:07.808767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb283e-19fd-4a53-a088-23c114cd1da1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:07.811514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:07.815577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c633fe-343c-49ad-88c3-418bef7c0ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:07.816219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c633fe-343c-49ad-88c3-418bef7c0ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:07.816742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c633fe-343c-49ad-88c3-418bef7c0ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:07.817209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c633fe-343c-49ad-88c3-418bef7c0ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:07.827752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c633fe-343c-49ad-88c3-418bef7c0ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:07.829943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c633fe-343c-49ad-88c3-418bef7c0ad9 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:07.841467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1106/2187] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:07.848245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:08.099329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:08.298853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:14.475562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73fc67-c9ac-4652-a45a-1ecd60741cde None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:14.477618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-aa73fc67-c9ac-4652-a45a-1ecd60741cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:14.564236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73fc67-c9ac-4652-a45a-1ecd60741cde None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:14.568968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:14.569746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:14.570028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:14.570298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] PATH_INFO: `/v3/users/e480b048e1044002825d9c4c2a107284` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:14.571446 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e480b048e1044002825d9c4c2a107284)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:14.573394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:14.757732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e480b048e1044002825d9c4c2a107284'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:14.758314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e480b048e1044002825d9c4c2a107284'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:14.765181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e480b048e1044002825d9c4c2a107284'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:14.778025 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e480b048e1044002825d9c4c2a107284'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:14.781085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:14.870153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e480b048e1044002825d9c4c2a107284'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:14.878617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1082/2188] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:14 2022] DELETE /identity/v3/users/e480b048e1044002825d9c4c2a107284 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:14.881527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50a209-9a9c-496d-8f40-7b9f0986c8b8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:14.882662 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50a209-9a9c-496d-8f40-7b9f0986c8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:14.882815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50a209-9a9c-496d-8f40-7b9f0986c8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:14.902534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ee50a209-9a9c-496d-8f40-7b9f0986c8b8 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:14.904099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ee50a209-9a9c-496d-8f40-7b9f0986c8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:14.971705 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1107/2189] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:14.981491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:14.982924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:15.047252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e42d1-82a6-4b49-9621-63b7dfc306c3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:15.050917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f491d66-ff90-45ad-9700-1fac9d51537e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:15.051545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f491d66-ff90-45ad-9700-1fac9d51537e service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:15.051862 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f491d66-ff90-45ad-9700-1fac9d51537e service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:15.052132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f491d66-ff90-45ad-9700-1fac9d51537e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:15.062246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f491d66-ff90-45ad-9700-1fac9d51537e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:15.063826 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f491d66-ff90-45ad-9700-1fac9d51537e service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:15.074704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1083/2190] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:15.478652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50a209-9a9c-496d-8f40-7b9f0986c8b8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:15.481291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ee50a209-9a9c-496d-8f40-7b9f0986c8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:15.499265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50a209-9a9c-496d-8f40-7b9f0986c8b8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:15.504136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:15.504775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:15.505047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:15.505314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] PATH_INFO: `/v3/projects/6018104d791f4a5086bacbe43864b2a6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:15.506468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6018104d791f4a5086bacbe43864b2a6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:15.523505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:15.651567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:15.652759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6018104d791f4a5086bacbe43864b2a6', 'request_id': 'req-20830be0-d018-49d7-aba5-f29ce109f70f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:15.658766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6018104d791f4a5086bacbe43864b2a6', 'request_id': 'req-20830be0-d018-49d7-aba5-f29ce109f70f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:15.665938 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6018104d791f4a5086bacbe43864b2a6', 'request_id': 'req-20830be0-d018-49d7-aba5-f29ce109f70f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:15.746075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] The token cache is being invalidate because project 6018104d791f4a5086bacbe43864b2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:15.750351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:15.750351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:15.750351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1108/2191] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:15 2022] DELETE /identity/v3/projects/6018104d791f4a5086bacbe43864b2a6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:15.753170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f491d66-ff90-45ad-9700-1fac9d51537e service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:15.766681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f491d66-ff90-45ad-9700-1fac9d51537e service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:15.857380 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acfc0c-3341-47dc-9da0-4eb2203ca09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:15.858271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acfc0c-3341-47dc-9da0-4eb2203ca09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:15.858271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acfc0c-3341-47dc-9da0-4eb2203ca09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:15.858662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acfc0c-3341-47dc-9da0-4eb2203ca09e admin admin] PATH_INFO: `/v3/users/3c54c066890e432ebfcf0b56b5528543` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:15.859972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acfc0c-3341-47dc-9da0-4eb2203ca09e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c54c066890e432ebfcf0b56b5528543)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:15.862281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acfc0c-3341-47dc-9da0-4eb2203ca09e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:16.069694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-00acfc0c-3341-47dc-9da0-4eb2203ca09e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c54c066890e432ebfcf0b56b5528543'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:16.071534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-00acfc0c-3341-47dc-9da0-4eb2203ca09e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c54c066890e432ebfcf0b56b5528543'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:16.078602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-00acfc0c-3341-47dc-9da0-4eb2203ca09e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c54c066890e432ebfcf0b56b5528543'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:16.093147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-00acfc0c-3341-47dc-9da0-4eb2203ca09e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c54c066890e432ebfcf0b56b5528543'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:16.203430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-00acfc0c-3341-47dc-9da0-4eb2203ca09e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c54c066890e432ebfcf0b56b5528543'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:16.211642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1084/2192] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:15 2022] DELETE /identity/v3/users/3c54c066890e432ebfcf0b56b5528543 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:25:16.640784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:16.642332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:16.657411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20830be0-d018-49d7-aba5-f29ce109f70f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:16.732653 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:16.737975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:16.737975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:16.737975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] PATH_INFO: `/v3/projects/4341dd53604447e1b287a16ea4a4470f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:16.737975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4341dd53604447e1b287a16ea4a4470f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:16.737975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:16.820450 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4341dd53604447e1b287a16ea4a4470f', 'request_id': 'req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:16.826020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4341dd53604447e1b287a16ea4a4470f', 'request_id': 'req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:16.832165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4341dd53604447e1b287a16ea4a4470f', 'request_id': 'req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:16.915926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] The token cache is being invalidate because project 4341dd53604447e1b287a16ea4a4470f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:16.916195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:16.916818 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-29d7e202-67b9-4fa2-b6d1-ba8da62f19ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:16.918335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1109/2193] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:16 2022] DELETE /identity/v3/projects/4341dd53604447e1b287a16ea4a4470f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:16.923318 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116e7a-5500-41a4-bfac-427b720c495a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:16.923767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116e7a-5500-41a4-bfac-427b720c495a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:16.923902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116e7a-5500-41a4-bfac-427b720c495a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:16.943880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3d116e7a-5500-41a4-bfac-427b720c495a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:16.945109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3d116e7a-5500-41a4-bfac-427b720c495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:16.954482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:17.003643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1085/2194] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:17.011690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22a61a-83ca-42f1-9632-a8fc8dfdeaed None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:17.012027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22a61a-83ca-42f1-9632-a8fc8dfdeaed None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:17.012306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22a61a-83ca-42f1-9632-a8fc8dfdeaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:17.033310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ea22a61a-83ca-42f1-9632-a8fc8dfdeaed None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:17.034621 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ea22a61a-83ca-42f1-9632-a8fc8dfdeaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:17.043262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1110/2195] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:17.047540 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d116e7a-5500-41a4-bfac-427b720c495a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:17.058363 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d116e7a-5500-41a4-bfac-427b720c495a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:17.063085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786922c-eb0d-4ac8-8686-84d5dea90281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:17.063713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786922c-eb0d-4ac8-8686-84d5dea90281 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:17.063997 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786922c-eb0d-4ac8-8686-84d5dea90281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:17.064265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786922c-eb0d-4ac8-8686-84d5dea90281 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:17.064924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786922c-eb0d-4ac8-8686-84d5dea90281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:25:17.065687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786922c-eb0d-4ac8-8686-84d5dea90281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:17.066915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786922c-eb0d-4ac8-8686-84d5dea90281 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:17.083632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1086/2196] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:25:17.087936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22a61a-83ca-42f1-9632-a8fc8dfdeaed None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:17.098731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22a61a-83ca-42f1-9632-a8fc8dfdeaed None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:17.104330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a4c1c-7027-4fc6-9123-070dd8dff194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:17.104821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a4c1c-7027-4fc6-9123-070dd8dff194 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:17.105038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a4c1c-7027-4fc6-9123-070dd8dff194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:17.105404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a4c1c-7027-4fc6-9123-070dd8dff194 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:17.106081 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a4c1c-7027-4fc6-9123-070dd8dff194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:17.108181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a4c1c-7027-4fc6-9123-070dd8dff194 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:17.217106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1111/2197] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:17 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:17.224500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786922c-eb0d-4ac8-8686-84d5dea90281 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:17.237762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786922c-eb0d-4ac8-8686-84d5dea90281 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:17.307271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9bec0-7332-48fb-8bd7-1a99b33e8123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:17.307882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9bec0-7332-48fb-8bd7-1a99b33e8123 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:17.308702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9bec0-7332-48fb-8bd7-1a99b33e8123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:17.308702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9bec0-7332-48fb-8bd7-1a99b33e8123 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:17.309194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9bec0-7332-48fb-8bd7-1a99b33e8123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:17.311132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9bec0-7332-48fb-8bd7-1a99b33e8123 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:17.407190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1087/2198] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:25:17 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:17.411723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a4c1c-7027-4fc6-9123-070dd8dff194 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:17.423226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a4c1c-7027-4fc6-9123-070dd8dff194 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:17.427804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ede6-b9cf-40f7-9e4c-6899cbac5687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:17.428394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ede6-b9cf-40f7-9e4c-6899cbac5687 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:17.429349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ede6-b9cf-40f7-9e4c-6899cbac5687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:17.429675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ede6-b9cf-40f7-9e4c-6899cbac5687 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:17.430316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9ede6-b9cf-40f7-9e4c-6899cbac5687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:17.431923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9ede6-b9cf-40f7-9e4c-6899cbac5687 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:17.441857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1112/2199] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:17.446391 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9bec0-7332-48fb-8bd7-1a99b33e8123 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:17.456557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9bec0-7332-48fb-8bd7-1a99b33e8123 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:17.461194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d9ed2-e426-4865-baf6-33181ab64f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:17.461811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d9ed2-e426-4865-baf6-33181ab64f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:17.462085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d9ed2-e426-4865-baf6-33181ab64f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:17.462349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d9ed2-e426-4865-baf6-33181ab64f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:17.463019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d9ed2-e426-4865-baf6-33181ab64f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:17.465115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d9ed2-e426-4865-baf6-33181ab64f07 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:17.476395 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1088/2200] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:25:17.480416 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ede6-b9cf-40f7-9e4c-6899cbac5687 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:17.490278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ede6-b9cf-40f7-9e4c-6899cbac5687 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:17.495722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a72c9-166b-422d-b3b9-0b24579bbe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:17.496376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a72c9-166b-422d-b3b9-0b24579bbe05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:17.496655 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a72c9-166b-422d-b3b9-0b24579bbe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:17.496927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a72c9-166b-422d-b3b9-0b24579bbe05 admin admin] PATH_INFO: `/v3/projects/147b76afb85f4e50bcd3cff3e88c34c5/users/c224a937854e46d999bcf48ad41fd0d6/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:17.513580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a72c9-166b-422d-b3b9-0b24579bbe05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=147b76afb85f4e50bcd3cff3e88c34c5, user_id=c224a937854e46d999bcf48ad41fd0d6, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:17.516336 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a72c9-166b-422d-b3b9-0b24579bbe05 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:17.596596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:17.603857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1113/2201] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:17 2022] PUT /identity/v3/projects/147b76afb85f4e50bcd3cff3e88c34c5/users/c224a937854e46d999bcf48ad41fd0d6/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:17.614421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c637-c3e9-4197-80a0-db5506036d5e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:17.614693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c637-c3e9-4197-80a0-db5506036d5e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:17.614971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c637-c3e9-4197-80a0-db5506036d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:17.643413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3305c637-c3e9-4197-80a0-db5506036d5e None None] MFA Rules not processed for user `c224a937854e46d999bcf48ad41fd0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:17.646148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3305c637-c3e9-4197-80a0-db5506036d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:17.717021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1089/2202] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:17.721569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a72c9-166b-422d-b3b9-0b24579bbe05 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:17.793116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a72c9-166b-422d-b3b9-0b24579bbe05 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:17.798154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f4bba-93b0-4561-982d-c49122b23dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:17.798816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f4bba-93b0-4561-982d-c49122b23dfa admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:17.799095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f4bba-93b0-4561-982d-c49122b23dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:17.799368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f4bba-93b0-4561-982d-c49122b23dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:17.800092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f4bba-93b0-4561-982d-c49122b23dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:17.802143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f4bba-93b0-4561-982d-c49122b23dfa admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:17.886922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1114/2203] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:17 2022] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:17.888055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305c637-c3e9-4197-80a0-db5506036d5e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:17.900568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305c637-c3e9-4197-80a0-db5506036d5e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:17.909309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:17.961689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3779a8-381c-43cb-9750-3c68e80cb74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:17.962355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3779a8-381c-43cb-9750-3c68e80cb74a admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:17.962584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3779a8-381c-43cb-9750-3c68e80cb74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:17.962816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3779a8-381c-43cb-9750-3c68e80cb74a admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:17.963437 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3779a8-381c-43cb-9750-3c68e80cb74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:17.965358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3779a8-381c-43cb-9750-3c68e80cb74a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:18.053332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1090/2204] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:25:17 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:25:18.057913 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f4bba-93b0-4561-982d-c49122b23dfa admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:18.069764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f4bba-93b0-4561-982d-c49122b23dfa admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:18.081074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70377-4c8b-41ad-9ec5-8f2ed4b69650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:18.081814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70377-4c8b-41ad-9ec5-8f2ed4b69650 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:18.082196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70377-4c8b-41ad-9ec5-8f2ed4b69650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:18.082368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70377-4c8b-41ad-9ec5-8f2ed4b69650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:18.083025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70377-4c8b-41ad-9ec5-8f2ed4b69650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:18.085242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70377-4c8b-41ad-9ec5-8f2ed4b69650 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:18.097754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1115/2205] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:18.102397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3779a8-381c-43cb-9750-3c68e80cb74a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:18.112838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3779a8-381c-43cb-9750-3c68e80cb74a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:18.121805 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4021f-9884-413e-8757-f316d2961c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:18.122510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4021f-9884-413e-8757-f316d2961c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:18.122785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4021f-9884-413e-8757-f316d2961c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:18.123053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4021f-9884-413e-8757-f316d2961c47 admin admin] PATH_INFO: `/v3/projects/33bb6e24ead3499abb8810b850aee8dd/users/650046fae02b4bb8bd2870646f2134d8/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:18.138680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4021f-9884-413e-8757-f316d2961c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33bb6e24ead3499abb8810b850aee8dd, user_id=650046fae02b4bb8bd2870646f2134d8, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:18.141275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4021f-9884-413e-8757-f316d2961c47 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:18.232234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1091/2206] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:18 2022] PUT /identity/v3/projects/33bb6e24ead3499abb8810b850aee8dd/users/650046fae02b4bb8bd2870646f2134d8/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:18.236118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70377-4c8b-41ad-9ec5-8f2ed4b69650 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:18.247468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70377-4c8b-41ad-9ec5-8f2ed4b69650 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:18.314836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6241ee5-b93a-4fd9-b8d6-b655c2026220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:18.315442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6241ee5-b93a-4fd9-b8d6-b655c2026220 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:18.315714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6241ee5-b93a-4fd9-b8d6-b655c2026220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:18.315979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6241ee5-b93a-4fd9-b8d6-b655c2026220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:18.316646 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6241ee5-b93a-4fd9-b8d6-b655c2026220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:18.318318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6241ee5-b93a-4fd9-b8d6-b655c2026220 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:18.329097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1116/2207] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:18.333094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4021f-9884-413e-8757-f316d2961c47 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:18.344309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4021f-9884-413e-8757-f316d2961c47 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:18.348926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253bf85-085f-4849-bc09-aaba3d43058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:18.349600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253bf85-085f-4849-bc09-aaba3d43058d admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:18.349874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253bf85-085f-4849-bc09-aaba3d43058d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:18.350141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253bf85-085f-4849-bc09-aaba3d43058d admin admin] PATH_INFO: `/v3/projects/33bb6e24ead3499abb8810b850aee8dd/users/650046fae02b4bb8bd2870646f2134d8/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:18.352803 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253bf85-085f-4849-bc09-aaba3d43058d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33bb6e24ead3499abb8810b850aee8dd, user_id=650046fae02b4bb8bd2870646f2134d8, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:18.355517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253bf85-085f-4849-bc09-aaba3d43058d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:18.365751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1092/2208] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:18 2022] PUT /identity/v3/projects/33bb6e24ead3499abb8810b850aee8dd/users/650046fae02b4bb8bd2870646f2134d8/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:18.377184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175ab8b-aec8-4c60-950f-4ec195638264 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:18.377565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175ab8b-aec8-4c60-950f-4ec195638264 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:18.377841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175ab8b-aec8-4c60-950f-4ec195638264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:18.415366 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f175ab8b-aec8-4c60-950f-4ec195638264 None None] MFA Rules not processed for user `650046fae02b4bb8bd2870646f2134d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:18.416923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f175ab8b-aec8-4c60-950f-4ec195638264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:18.490152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:18.500370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1117/2209] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:25:18.513036 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253bf85-085f-4849-bc09-aaba3d43058d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:18.514744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c253bf85-085f-4849-bc09-aaba3d43058d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:18.587879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253bf85-085f-4849-bc09-aaba3d43058d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:18.591635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7a22c-668a-4cee-96c0-ff9dc671305e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:18.592259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a22c-668a-4cee-96c0-ff9dc671305e service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:18.592532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a22c-668a-4cee-96c0-ff9dc671305e service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:18.592797 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7a22c-668a-4cee-96c0-ff9dc671305e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:18.607899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7a22c-668a-4cee-96c0-ff9dc671305e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:18.608009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7a22c-668a-4cee-96c0-ff9dc671305e service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:18.618767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1093/2210] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:18.844176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175ab8b-aec8-4c60-950f-4ec195638264 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:18.845650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f175ab8b-aec8-4c60-950f-4ec195638264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:18.857888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175ab8b-aec8-4c60-950f-4ec195638264 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:18.861461 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78c576-9c14-4e6a-9b88-8f9e0a74ae13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:18.862054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c576-9c14-4e6a-9b88-8f9e0a74ae13 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:18.862329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c576-9c14-4e6a-9b88-8f9e0a74ae13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:18.862595 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c576-9c14-4e6a-9b88-8f9e0a74ae13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:18.922243 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78c576-9c14-4e6a-9b88-8f9e0a74ae13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:18.923686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78c576-9c14-4e6a-9b88-8f9e0a74ae13 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:18.933032 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1118/2211] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:21.135669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7a22c-668a-4cee-96c0-ff9dc671305e service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:21.137172 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-58c7a22c-668a-4cee-96c0-ff9dc671305e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:21.207112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7a22c-668a-4cee-96c0-ff9dc671305e service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:21.212006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:21.212632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:21.213289 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:21.213605 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] PATH_INFO: `/v3/users/c3464154f794432c82912d6ef82dd77d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:21.214743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3464154f794432c82912d6ef82dd77d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:21.216740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:21.222199 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:21.461190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3464154f794432c82912d6ef82dd77d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:21.461893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3464154f794432c82912d6ef82dd77d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:21.468787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3464154f794432c82912d6ef82dd77d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:21.480559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3464154f794432c82912d6ef82dd77d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:21.538256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3464154f794432c82912d6ef82dd77d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:21.544647 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1094/2212] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:21 2022] DELETE /identity/v3/users/c3464154f794432c82912d6ef82dd77d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:21.549264 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9caa1-0eab-466c-8f2b-369ad1dbbea2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:21.549773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9caa1-0eab-466c-8f2b-369ad1dbbea2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:21.549864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9caa1-0eab-466c-8f2b-369ad1dbbea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:21.572576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0dc9caa1-0eab-466c-8f2b-369ad1dbbea2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:21.577406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0dc9caa1-0eab-466c-8f2b-369ad1dbbea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:21.634012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1119/2213] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:21.643723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:21.645181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:21.703271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1333772-c5e7-4a54-b869-8c86f8ea137b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:21.706847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879328c-7300-4c9c-b7bb-fb8c30226b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:21.707447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879328c-7300-4c9c-b7bb-fb8c30226b41 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:21.707722 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879328c-7300-4c9c-b7bb-fb8c30226b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:21.707988 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879328c-7300-4c9c-b7bb-fb8c30226b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:21.717864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879328c-7300-4c9c-b7bb-fb8c30226b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:21.719293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879328c-7300-4c9c-b7bb-fb8c30226b41 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:21.730313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1095/2214] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:22.190930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9caa1-0eab-466c-8f2b-369ad1dbbea2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:22.192540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0dc9caa1-0eab-466c-8f2b-369ad1dbbea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:22.204869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9caa1-0eab-466c-8f2b-369ad1dbbea2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:22.209635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:22.210568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:22.210946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:22.211225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] PATH_INFO: `/v3/projects/0368f88625bf49c381e1ef9003812354` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:22.212687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0368f88625bf49c381e1ef9003812354)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:22.225855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:22.323178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0368f88625bf49c381e1ef9003812354', 'request_id': 'req-f39a44ff-2dca-4a73-980f-01668d7f0359'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:22.329740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0368f88625bf49c381e1ef9003812354', 'request_id': 'req-f39a44ff-2dca-4a73-980f-01668d7f0359'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:22.340581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0368f88625bf49c381e1ef9003812354', 'request_id': 'req-f39a44ff-2dca-4a73-980f-01668d7f0359'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:22.423184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] The token cache is being invalidate because project 0368f88625bf49c381e1ef9003812354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:22.423475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:22.424235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f39a44ff-2dca-4a73-980f-01668d7f0359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:22.425815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1120/2215] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:22 2022] DELETE /identity/v3/projects/0368f88625bf49c381e1ef9003812354 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:22.597992 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879328c-7300-4c9c-b7bb-fb8c30226b41 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:22.601200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0879328c-7300-4c9c-b7bb-fb8c30226b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:22.627918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879328c-7300-4c9c-b7bb-fb8c30226b41 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:22.709971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:22.710609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:22.711074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:22.711416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] PATH_INFO: `/v3/users/c224a937854e46d999bcf48ad41fd0d6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:22.712733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c224a937854e46d999bcf48ad41fd0d6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:22.714798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:22.888223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:22.909674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c224a937854e46d999bcf48ad41fd0d6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:22.910334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c224a937854e46d999bcf48ad41fd0d6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:22.918572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c224a937854e46d999bcf48ad41fd0d6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:22.933388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c224a937854e46d999bcf48ad41fd0d6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:23.039836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c224a937854e46d999bcf48ad41fd0d6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:23.047235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1096/2216] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:22 2022] DELETE /identity/v3/users/c224a937854e46d999bcf48ad41fd0d6 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:23.051876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbac21-a214-4cb1-9d63-5a773aa54c6b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:23.052960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbac21-a214-4cb1-9d63-5a773aa54c6b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:23.053329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbac21-a214-4cb1-9d63-5a773aa54c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:23.081793 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-92cbac21-a214-4cb1-9d63-5a773aa54c6b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:23.083024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-92cbac21-a214-4cb1-9d63-5a773aa54c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:23.094430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:23.152421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1121/2217] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:23.163407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:23.165024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:23.232567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c92efd-1672-4bbb-bfac-f34e2a8ecdf3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:23.237128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d482b-1b2b-44a0-a250-bf57e191e3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:23.238324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d482b-1b2b-44a0-a250-bf57e191e3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:23.238553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d482b-1b2b-44a0-a250-bf57e191e3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:23.238781 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d482b-1b2b-44a0-a250-bf57e191e3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:23.249727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d482b-1b2b-44a0-a250-bf57e191e3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:23.251302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d482b-1b2b-44a0-a250-bf57e191e3d9 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:23.262845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1097/2218] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:23.802376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbac21-a214-4cb1-9d63-5a773aa54c6b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:23.804430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-92cbac21-a214-4cb1-9d63-5a773aa54c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:23.816949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbac21-a214-4cb1-9d63-5a773aa54c6b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:23.823680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:23.829121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:23.829121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:23.829121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] PATH_INFO: `/v3/projects/147b76afb85f4e50bcd3cff3e88c34c5` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:23.829121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=147b76afb85f4e50bcd3cff3e88c34c5)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:23.829121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:23.963155 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147b76afb85f4e50bcd3cff3e88c34c5', 'request_id': 'req-18c535a6-1787-43b6-8774-6ad6b835feb6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:23.968645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147b76afb85f4e50bcd3cff3e88c34c5', 'request_id': 'req-18c535a6-1787-43b6-8774-6ad6b835feb6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:23.974854 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147b76afb85f4e50bcd3cff3e88c34c5', 'request_id': 'req-18c535a6-1787-43b6-8774-6ad6b835feb6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:24.042858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] The token cache is being invalidate because project 147b76afb85f4e50bcd3cff3e88c34c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:24.043149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:24.043785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:24.045932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1122/2219] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:23 2022] DELETE /identity/v3/projects/147b76afb85f4e50bcd3cff3e88c34c5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:24.049739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d482b-1b2b-44a0-a250-bf57e191e3d9 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:24.061599 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d482b-1b2b-44a0-a250-bf57e191e3d9 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:24.122847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e56637-25c0-4a8f-af06-c343c5e527c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:24.123871 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e56637-25c0-4a8f-af06-c343c5e527c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:24.124215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e56637-25c0-4a8f-af06-c343c5e527c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:24.124582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e56637-25c0-4a8f-af06-c343c5e527c2 admin admin] PATH_INFO: `/v3/users/650046fae02b4bb8bd2870646f2134d8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:24.125832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e56637-25c0-4a8f-af06-c343c5e527c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=650046fae02b4bb8bd2870646f2134d8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:24.127901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e56637-25c0-4a8f-af06-c343c5e527c2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:24.416668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-79e56637-25c0-4a8f-af06-c343c5e527c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650046fae02b4bb8bd2870646f2134d8'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:24.417426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-79e56637-25c0-4a8f-af06-c343c5e527c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650046fae02b4bb8bd2870646f2134d8'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:24.422277 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:24.425631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-79e56637-25c0-4a8f-af06-c343c5e527c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650046fae02b4bb8bd2870646f2134d8'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:24.440604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-79e56637-25c0-4a8f-af06-c343c5e527c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650046fae02b4bb8bd2870646f2134d8'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:24.567174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-79e56637-25c0-4a8f-af06-c343c5e527c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650046fae02b4bb8bd2870646f2134d8'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:24.574712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1098/2220] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:24 2022] DELETE /identity/v3/users/650046fae02b4bb8bd2870646f2134d8 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:25.128900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:25.132547 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:25.174008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c535a6-1787-43b6-8774-6ad6b835feb6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:25.236621 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:25.237259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:25.237605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:25.237830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] PATH_INFO: `/v3/projects/33bb6e24ead3499abb8810b850aee8dd` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:25.238961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33bb6e24ead3499abb8810b850aee8dd)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:25.241676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:25.339397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:25.345770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33bb6e24ead3499abb8810b850aee8dd', 'request_id': 'req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:25.352219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33bb6e24ead3499abb8810b850aee8dd', 'request_id': 'req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:25.358773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33bb6e24ead3499abb8810b850aee8dd', 'request_id': 'req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:25.400612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] The token cache is being invalidate because project 33bb6e24ead3499abb8810b850aee8dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:25.400899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:25.401551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-69ab5393-261d-4fb2-a13b-aff2c7a3ba74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:25.403485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1123/2221] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:25 2022] DELETE /identity/v3/projects/33bb6e24ead3499abb8810b850aee8dd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:25.408539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e54f2-8ad3-4403-9af3-d4e7efda22d5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:25.409063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e54f2-8ad3-4403-9af3-d4e7efda22d5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:25.409063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e54f2-8ad3-4403-9af3-d4e7efda22d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:25.429706 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-482e54f2-8ad3-4403-9af3-d4e7efda22d5 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:25.430960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-482e54f2-8ad3-4403-9af3-d4e7efda22d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:25.525842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1099/2222] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:25.537264 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd09931-fab6-44f9-a416-2ad7c21f30f3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:25.537633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd09931-fab6-44f9-a416-2ad7c21f30f3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:25.537878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd09931-fab6-44f9-a416-2ad7c21f30f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:25.568174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7dd09931-fab6-44f9-a416-2ad7c21f30f3 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:25.568174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7dd09931-fab6-44f9-a416-2ad7c21f30f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:25.577661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e54f2-8ad3-4403-9af3-d4e7efda22d5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:25.581491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1124/2223] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:25.589298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e54f2-8ad3-4403-9af3-d4e7efda22d5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:25.594203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef66e-269a-4f5c-b648-8b5db6f488da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:25.594932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef66e-269a-4f5c-b648-8b5db6f488da admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:25.595588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef66e-269a-4f5c-b648-8b5db6f488da admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:25.595588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ef66e-269a-4f5c-b648-8b5db6f488da admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:25.596119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ef66e-269a-4f5c-b648-8b5db6f488da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:25:25.596420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ef66e-269a-4f5c-b648-8b5db6f488da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:25.598084 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ef66e-269a-4f5c-b648-8b5db6f488da admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:25.619837 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1100/2224] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:25:25.621196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd09931-fab6-44f9-a416-2ad7c21f30f3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:25.635390 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd09931-fab6-44f9-a416-2ad7c21f30f3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:25.641515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ca18d-0f0a-4044-91bd-8f59c08d4cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:25.642346 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ca18d-0f0a-4044-91bd-8f59c08d4cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:25.642690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ca18d-0f0a-4044-91bd-8f59c08d4cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:25.643072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ca18d-0f0a-4044-91bd-8f59c08d4cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:25.644371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ca18d-0f0a-4044-91bd-8f59c08d4cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:25.647359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ca18d-0f0a-4044-91bd-8f59c08d4cf5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:25.784442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1125/2225] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:25 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:25.789301 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef66e-269a-4f5c-b648-8b5db6f488da admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:25.799568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ef66e-269a-4f5c-b648-8b5db6f488da admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:25.817640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0febd-240b-469e-8512-799f87f60c01 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:25.817918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0febd-240b-469e-8512-799f87f60c01 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:25.818183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0febd-240b-469e-8512-799f87f60c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:25.837588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-44c0febd-240b-469e-8512-799f87f60c01 None None] MFA Rules not processed for user `b9d6d909e5e24923bbfc53fcf9975425`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:25.840395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-44c0febd-240b-469e-8512-799f87f60c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:25.860153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace53b48-4223-4982-9015-172f6ab95e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:25.863639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace53b48-4223-4982-9015-172f6ab95e08 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:25.863639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace53b48-4223-4982-9015-172f6ab95e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:25.863639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace53b48-4223-4982-9015-172f6ab95e08 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:25.863639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace53b48-4223-4982-9015-172f6ab95e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:25.864151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace53b48-4223-4982-9015-172f6ab95e08 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:25.894567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1126/2226] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:25:25.950771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1101/2227] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:25:25 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:25:25.954706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0febd-240b-469e-8512-799f87f60c01 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:25.966899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0febd-240b-469e-8512-799f87f60c01 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:25.971853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d26d31-16ab-4fd9-8a05-62a78d542c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:25.972570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d26d31-16ab-4fd9-8a05-62a78d542c6c admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:25.972843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d26d31-16ab-4fd9-8a05-62a78d542c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:25.973109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d26d31-16ab-4fd9-8a05-62a78d542c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:25.973798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d26d31-16ab-4fd9-8a05-62a78d542c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:25.975426 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d26d31-16ab-4fd9-8a05-62a78d542c6c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:25.988724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1127/2228] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:25.990119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace53b48-4223-4982-9015-172f6ab95e08 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:26.000270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace53b48-4223-4982-9015-172f6ab95e08 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:26.005127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73aa8d9-00be-4243-8645-b3277c3a9c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:26.005766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73aa8d9-00be-4243-8645-b3277c3a9c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:26.006046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73aa8d9-00be-4243-8645-b3277c3a9c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:26.006865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73aa8d9-00be-4243-8645-b3277c3a9c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:26.007514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73aa8d9-00be-4243-8645-b3277c3a9c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:26.009125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73aa8d9-00be-4243-8645-b3277c3a9c7c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:26.020150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1102/2229] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:25:26.024852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d26d31-16ab-4fd9-8a05-62a78d542c6c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:26.035044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d26d31-16ab-4fd9-8a05-62a78d542c6c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:26.039793 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8955e-33c7-4773-9b43-e83e2c9cf230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:26.040418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8955e-33c7-4773-9b43-e83e2c9cf230 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:26.040689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8955e-33c7-4773-9b43-e83e2c9cf230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:26.040963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8955e-33c7-4773-9b43-e83e2c9cf230 admin admin] PATH_INFO: `/v3/projects/090848b0e0544325a23c7e1e69f402ce/users/3d70bbb5a0834093936c73b8151157ad/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:26.055429 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8955e-33c7-4773-9b43-e83e2c9cf230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=090848b0e0544325a23c7e1e69f402ce, user_id=3d70bbb5a0834093936c73b8151157ad, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:26.058257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8955e-33c7-4773-9b43-e83e2c9cf230 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:26.124320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1128/2230] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:26 2022] PUT /identity/v3/projects/090848b0e0544325a23c7e1e69f402ce/users/3d70bbb5a0834093936c73b8151157ad/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:25:26.137060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442394e-f4a0-4b0e-945a-6cf33d500719 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:26.137468 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442394e-f4a0-4b0e-945a-6cf33d500719 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:26.138420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442394e-f4a0-4b0e-945a-6cf33d500719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:26.177007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9442394e-f4a0-4b0e-945a-6cf33d500719 None None] MFA Rules not processed for user `3d70bbb5a0834093936c73b8151157ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:26.178957 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9442394e-f4a0-4b0e-945a-6cf33d500719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:26.213358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:26.262042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1103/2231] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:26.266911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8955e-33c7-4773-9b43-e83e2c9cf230 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:26.336159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8955e-33c7-4773-9b43-e83e2c9cf230 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:26.341047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2049151-b101-4321-b514-b3ef18fd9d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:26.341684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2049151-b101-4321-b514-b3ef18fd9d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:26.341963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2049151-b101-4321-b514-b3ef18fd9d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:26.342256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2049151-b101-4321-b514-b3ef18fd9d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:26.342909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2049151-b101-4321-b514-b3ef18fd9d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:26.345260 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2049151-b101-4321-b514-b3ef18fd9d17 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:26.361441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:26.442544 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1129/2232] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:26 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:25:26.446751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442394e-f4a0-4b0e-945a-6cf33d500719 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:26.457751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442394e-f4a0-4b0e-945a-6cf33d500719 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:26.516985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832019e3-0417-41e7-83b7-74f31e76ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:26.517669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832019e3-0417-41e7-83b7-74f31e76ef14 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:26.517952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832019e3-0417-41e7-83b7-74f31e76ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:26.518246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832019e3-0417-41e7-83b7-74f31e76ef14 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:26.518882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832019e3-0417-41e7-83b7-74f31e76ef14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:26.520824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832019e3-0417-41e7-83b7-74f31e76ef14 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:26.617458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1104/2233] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:25:26 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:26.621634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2049151-b101-4321-b514-b3ef18fd9d17 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:26.642967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2049151-b101-4321-b514-b3ef18fd9d17 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:26.643963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab98455-9137-4d9f-a60e-d9de73ba5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:26.644809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab98455-9137-4d9f-a60e-d9de73ba5269 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:26.645198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab98455-9137-4d9f-a60e-d9de73ba5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:26.645569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab98455-9137-4d9f-a60e-d9de73ba5269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:26.646280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab98455-9137-4d9f-a60e-d9de73ba5269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:26.648561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab98455-9137-4d9f-a60e-d9de73ba5269 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:26.661700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1130/2234] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:26.666013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832019e3-0417-41e7-83b7-74f31e76ef14 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:26.698340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832019e3-0417-41e7-83b7-74f31e76ef14 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:26.704560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b129d13-5e05-4130-a3f0-e65acd57ea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:26.704560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129d13-5e05-4130-a3f0-e65acd57ea19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:26.704560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129d13-5e05-4130-a3f0-e65acd57ea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:26.704560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129d13-5e05-4130-a3f0-e65acd57ea19 admin admin] PATH_INFO: `/v3/projects/f955ae51a401472087d79508f6ef8ae2/users/1efaea63ea344547a07994ffc738f458/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:26.719872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b129d13-5e05-4130-a3f0-e65acd57ea19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f955ae51a401472087d79508f6ef8ae2, user_id=1efaea63ea344547a07994ffc738f458, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:26.722558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b129d13-5e05-4130-a3f0-e65acd57ea19 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:26.805166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1105/2235] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:26 2022] PUT /identity/v3/projects/f955ae51a401472087d79508f6ef8ae2/users/1efaea63ea344547a07994ffc738f458/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:26.806196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab98455-9137-4d9f-a60e-d9de73ba5269 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:26.816975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab98455-9137-4d9f-a60e-d9de73ba5269 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:26.885332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8981d-29fb-40fc-bb54-8d368ff3ee28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:26.885899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8981d-29fb-40fc-bb54-8d368ff3ee28 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:26.886179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8981d-29fb-40fc-bb54-8d368ff3ee28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:26.886449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8981d-29fb-40fc-bb54-8d368ff3ee28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:26.887104 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8981d-29fb-40fc-bb54-8d368ff3ee28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:26.888715 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8981d-29fb-40fc-bb54-8d368ff3ee28 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:26.900019 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1131/2236] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:26.904229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b129d13-5e05-4130-a3f0-e65acd57ea19 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:26.915717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b129d13-5e05-4130-a3f0-e65acd57ea19 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:26.920356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119aca1-1b40-4a4a-a02a-8b03b29c2dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:26.921025 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119aca1-1b40-4a4a-a02a-8b03b29c2dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:26.921304 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119aca1-1b40-4a4a-a02a-8b03b29c2dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:26.921608 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119aca1-1b40-4a4a-a02a-8b03b29c2dbe admin admin] PATH_INFO: `/v3/projects/f955ae51a401472087d79508f6ef8ae2/users/1efaea63ea344547a07994ffc738f458/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:26.923505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119aca1-1b40-4a4a-a02a-8b03b29c2dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f955ae51a401472087d79508f6ef8ae2, user_id=1efaea63ea344547a07994ffc738f458, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:26.926179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119aca1-1b40-4a4a-a02a-8b03b29c2dbe admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:26.937215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1106/2237] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:26 2022] PUT /identity/v3/projects/f955ae51a401472087d79508f6ef8ae2/users/1efaea63ea344547a07994ffc738f458/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:26.947915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f774f-4af9-4183-bab5-e92e5ea9d74f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:26.948197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f774f-4af9-4183-bab5-e92e5ea9d74f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:26.948474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f774f-4af9-4183-bab5-e92e5ea9d74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:26.978388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8c3f774f-4af9-4183-bab5-e92e5ea9d74f None None] MFA Rules not processed for user `1efaea63ea344547a07994ffc738f458`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:26.979709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8c3f774f-4af9-4183-bab5-e92e5ea9d74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:27.047814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1132/2238] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:27.060637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119aca1-1b40-4a4a-a02a-8b03b29c2dbe admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:27.062594 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e119aca1-1b40-4a4a-a02a-8b03b29c2dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:27.123178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119aca1-1b40-4a4a-a02a-8b03b29c2dbe admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:27.126962 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d6c2c-57c8-47b8-b486-4043ecac079f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:27.127507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d6c2c-57c8-47b8-b486-4043ecac079f service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:27.127786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d6c2c-57c8-47b8-b486-4043ecac079f service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:27.128051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d6c2c-57c8-47b8-b486-4043ecac079f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:27.136958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d6c2c-57c8-47b8-b486-4043ecac079f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:27.138355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d6c2c-57c8-47b8-b486-4043ecac079f service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:27.148286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1107/2239] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:28.170543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f774f-4af9-4183-bab5-e92e5ea9d74f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:28.180758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f774f-4af9-4183-bab5-e92e5ea9d74f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:28.185454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdc870-5f56-4e77-a030-621f340de342 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1efaea63ea344547a07994ffc738f458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f955ae51a401472087d79508f6ef8ae2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:28.186062 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdc870-5f56-4e77-a030-621f340de342 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:28.186345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdc870-5f56-4e77-a030-621f340de342 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:28.186620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdc870-5f56-4e77-a030-621f340de342 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:28.187270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdc870-5f56-4e77-a030-621f340de342 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:25:28.187573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdc870-5f56-4e77-a030-621f340de342 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:28.189198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdc870-5f56-4e77-a030-621f340de342 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:28.201688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1133/2240] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:25:28.205818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d6c2c-57c8-47b8-b486-4043ecac079f service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:28.215797 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d6c2c-57c8-47b8-b486-4043ecac079f service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:28.220290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa904-548c-4ee0-9bdf-18b3cf26e243 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1efaea63ea344547a07994ffc738f458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f955ae51a401472087d79508f6ef8ae2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:28.220882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa904-548c-4ee0-9bdf-18b3cf26e243 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:28.226327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa904-548c-4ee0-9bdf-18b3cf26e243 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:28.226327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa904-548c-4ee0-9bdf-18b3cf26e243 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:28.226327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caa904-548c-4ee0-9bdf-18b3cf26e243 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:28.226327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caa904-548c-4ee0-9bdf-18b3cf26e243 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:28.343228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:28.350821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1108/2241] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:28 2022] POST /identity/v3/projects => generated 354 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:28.354983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdc870-5f56-4e77-a030-621f340de342 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:28.365341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdc870-5f56-4e77-a030-621f340de342 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:28.424478 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:28.433160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4591-8c3f-4d08-8076-0fb49e74dd4d tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1efaea63ea344547a07994ffc738f458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f955ae51a401472087d79508f6ef8ae2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:28.433800 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4591-8c3f-4d08-8076-0fb49e74dd4d tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:28.434073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4591-8c3f-4d08-8076-0fb49e74dd4d tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:28.434343 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4591-8c3f-4d08-8076-0fb49e74dd4d tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:28.434981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d4591-8c3f-4d08-8076-0fb49e74dd4d tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:25:28.435277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d4591-8c3f-4d08-8076-0fb49e74dd4d tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:28.436894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d4591-8c3f-4d08-8076-0fb49e74dd4d tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:28.448949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1134/2242] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:25:28.485908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa904-548c-4ee0-9bdf-18b3cf26e243 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:28.497191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa904-548c-4ee0-9bdf-18b3cf26e243 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:28.501853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1efaea63ea344547a07994ffc738f458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f955ae51a401472087d79508f6ef8ae2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:28.502493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:28.502753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:28.503021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] PATH_INFO: `/v3/projects/dc33fcbac2ae405ea944b1e6fae1e55c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:28.504126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dc33fcbac2ae405ea944b1e6fae1e55c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:28.506640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:28.625967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc33fcbac2ae405ea944b1e6fae1e55c', 'request_id': 'req-8d57af43-13e4-4d22-948c-65cddc15b4a1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:28.632414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc33fcbac2ae405ea944b1e6fae1e55c', 'request_id': 'req-8d57af43-13e4-4d22-948c-65cddc15b4a1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:28.708680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc33fcbac2ae405ea944b1e6fae1e55c', 'request_id': 'req-8d57af43-13e4-4d22-948c-65cddc15b4a1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:28.728979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] The token cache is being invalidate because project dc33fcbac2ae405ea944b1e6fae1e55c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:28.729271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:28.730140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8d57af43-13e4-4d22-948c-65cddc15b4a1 tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:28.731859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1109/2243] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:28 2022] DELETE /identity/v3/projects/dc33fcbac2ae405ea944b1e6fae1e55c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:29.518930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4591-8c3f-4d08-8076-0fb49e74dd4d tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:29.520804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ce4d4591-8c3f-4d08-8076-0fb49e74dd4d tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:29.588532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4591-8c3f-4d08-8076-0fb49e74dd4d tempest-VolumeQuotaClassesTest-1010807315 tempest-VolumeQuotaClassesTest-1010807315-project-admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:29.655003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:29.655639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:29.655908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:29.656336 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] PATH_INFO: `/v3/users/3d70bbb5a0834093936c73b8151157ad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:29.658637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d70bbb5a0834093936c73b8151157ad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:29.660758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:29.867148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d70bbb5a0834093936c73b8151157ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:29.867836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d70bbb5a0834093936c73b8151157ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:29.894535 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d70bbb5a0834093936c73b8151157ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:29.905472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d70bbb5a0834093936c73b8151157ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:29.906018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d70bbb5a0834093936c73b8151157ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:29.964183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1135/2244] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:29 2022] DELETE /identity/v3/users/3d70bbb5a0834093936c73b8151157ad => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:29.970890 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbbd78-3c07-463d-841b-c28c5ce4fac2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:29.971366 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbbd78-3c07-463d-841b-c28c5ce4fac2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:29.971459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbbd78-3c07-463d-841b-c28c5ce4fac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:30.015395 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-80bbbd78-3c07-463d-841b-c28c5ce4fac2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:30.017164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-80bbbd78-3c07-463d-841b-c28c5ce4fac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:30.112296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1110/2245] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:30.123996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:30.124956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:30.145883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:30.214257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218b113-af34-4bbc-93b3-9b4a4071c376 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:30.218424 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7a7c1-5388-485b-a14d-ce0349e9cb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:30.219103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7a7c1-5388-485b-a14d-ce0349e9cb3d service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:30.219384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7a7c1-5388-485b-a14d-ce0349e9cb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:30.219653 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7a7c1-5388-485b-a14d-ce0349e9cb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:30.230213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7a7c1-5388-485b-a14d-ce0349e9cb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:30.231677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7a7c1-5388-485b-a14d-ce0349e9cb3d service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:30.243638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1136/2246] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:30.946196 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbbd78-3c07-463d-841b-c28c5ce4fac2 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:30.947617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-80bbbd78-3c07-463d-841b-c28c5ce4fac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:30.978014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbbd78-3c07-463d-841b-c28c5ce4fac2 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:30.984456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:30.985229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:30.986717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:30.986717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] PATH_INFO: `/v3/projects/090848b0e0544325a23c7e1e69f402ce` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:30.988000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=090848b0e0544325a23c7e1e69f402ce)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:30.990775 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:31.149948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090848b0e0544325a23c7e1e69f402ce', 'request_id': 'req-a46a4984-7241-49fd-ad2f-2ec1ce083877'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:31.155573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090848b0e0544325a23c7e1e69f402ce', 'request_id': 'req-a46a4984-7241-49fd-ad2f-2ec1ce083877'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:31.269851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090848b0e0544325a23c7e1e69f402ce', 'request_id': 'req-a46a4984-7241-49fd-ad2f-2ec1ce083877'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:31.284007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] The token cache is being invalidate because project 090848b0e0544325a23c7e1e69f402ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:31.284302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:31.285036 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:31.287715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1111/2247] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:30 2022] DELETE /identity/v3/projects/090848b0e0544325a23c7e1e69f402ce => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:31.292253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7a7c1-5388-485b-a14d-ce0349e9cb3d service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:31.302002 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7a7c1-5388-485b-a14d-ce0349e9cb3d service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:31.363846 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df658c8d-e83e-4df3-b360-e49944ac767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:31.364289 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658c8d-e83e-4df3-b360-e49944ac767d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:31.364615 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658c8d-e83e-4df3-b360-e49944ac767d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:31.364887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658c8d-e83e-4df3-b360-e49944ac767d admin admin] PATH_INFO: `/v3/users/1efaea63ea344547a07994ffc738f458` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:31.366461 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df658c8d-e83e-4df3-b360-e49944ac767d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1efaea63ea344547a07994ffc738f458)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:31.368381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df658c8d-e83e-4df3-b360-e49944ac767d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:31.511140 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df658c8d-e83e-4df3-b360-e49944ac767d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1efaea63ea344547a07994ffc738f458'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:31.511708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df658c8d-e83e-4df3-b360-e49944ac767d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1efaea63ea344547a07994ffc738f458'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:31.523511 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df658c8d-e83e-4df3-b360-e49944ac767d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1efaea63ea344547a07994ffc738f458'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:31.530230 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df658c8d-e83e-4df3-b360-e49944ac767d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1efaea63ea344547a07994ffc738f458'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:31.530865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df658c8d-e83e-4df3-b360-e49944ac767d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1efaea63ea344547a07994ffc738f458'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:31.605487 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1137/2248] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:31 2022] DELETE /identity/v3/users/1efaea63ea344547a07994ffc738f458 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:32.195623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:32.197128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:32.207300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:32.212069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a4984-7241-49fd-ad2f-2ec1ce083877 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:32.272872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:32.275247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:32.275543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:32.275819 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] PATH_INFO: `/v3/projects/f955ae51a401472087d79508f6ef8ae2` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:32.277025 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f955ae51a401472087d79508f6ef8ae2)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:32.279717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:32.428712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f955ae51a401472087d79508f6ef8ae2', 'request_id': 'req-ed107486-3215-4c34-a4be-8bf367b4d49f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:32.439588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f955ae51a401472087d79508f6ef8ae2', 'request_id': 'req-ed107486-3215-4c34-a4be-8bf367b4d49f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:32.544887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f955ae51a401472087d79508f6ef8ae2', 'request_id': 'req-ed107486-3215-4c34-a4be-8bf367b4d49f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:32.559418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] The token cache is being invalidate because project f955ae51a401472087d79508f6ef8ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:32.559948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:32.560954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ed107486-3215-4c34-a4be-8bf367b4d49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:32.562615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1112/2249] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:32 2022] DELETE /identity/v3/projects/f955ae51a401472087d79508f6ef8ae2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:32.569463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb7e8-41c8-46c3-8578-c24125e38d3f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:32.569974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb7e8-41c8-46c3-8578-c24125e38d3f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:32.569974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb7e8-41c8-46c3-8578-c24125e38d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:32.603253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-551eb7e8-41c8-46c3-8578-c24125e38d3f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:32.604591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-551eb7e8-41c8-46c3-8578-c24125e38d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:32.636069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:32.664990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1138/2250] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:32.672791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e5b0-2eda-4b73-9ef7-8d52f14bb7ed None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:32.673076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e5b0-2eda-4b73-9ef7-8d52f14bb7ed None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:32.676453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e5b0-2eda-4b73-9ef7-8d52f14bb7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:32.694304 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1424e5b0-2eda-4b73-9ef7-8d52f14bb7ed None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:32.695501 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1424e5b0-2eda-4b73-9ef7-8d52f14bb7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:32.703428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1113/2251] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:32.707737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eb7e8-41c8-46c3-8578-c24125e38d3f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:32.717925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eb7e8-41c8-46c3-8578-c24125e38d3f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:32.722548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fd733-f1d8-4a82-9d11-4c01c6982125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:32.723145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fd733-f1d8-4a82-9d11-4c01c6982125 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:32.723418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fd733-f1d8-4a82-9d11-4c01c6982125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:32.723687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fd733-f1d8-4a82-9d11-4c01c6982125 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:32.724368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fd733-f1d8-4a82-9d11-4c01c6982125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:25:32.724757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fd733-f1d8-4a82-9d11-4c01c6982125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:32.726402 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fd733-f1d8-4a82-9d11-4c01c6982125 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:32.737812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1139/2252] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:25:32.742147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424e5b0-2eda-4b73-9ef7-8d52f14bb7ed None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:32.751785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424e5b0-2eda-4b73-9ef7-8d52f14bb7ed None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:32.758531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a3c09-6508-4e6c-8a67-94265fa5c28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:32.759141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a3c09-6508-4e6c-8a67-94265fa5c28c admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:32.759425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a3c09-6508-4e6c-8a67-94265fa5c28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:32.759688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a3c09-6508-4e6c-8a67-94265fa5c28c admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:32.760338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a3c09-6508-4e6c-8a67-94265fa5c28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:32.762294 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a3c09-6508-4e6c-8a67-94265fa5c28c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:32.878390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1114/2253] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:32 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:32.888058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fd733-f1d8-4a82-9d11-4c01c6982125 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:32.899537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fd733-f1d8-4a82-9d11-4c01c6982125 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:32.963292 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465e303-182d-4f92-b98d-c534f53112c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:32.963902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e303-182d-4f92-b98d-c534f53112c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:32.964210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e303-182d-4f92-b98d-c534f53112c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:32.964485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e303-182d-4f92-b98d-c534f53112c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:32.965116 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465e303-182d-4f92-b98d-c534f53112c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:32.967106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465e303-182d-4f92-b98d-c534f53112c5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:33.086662 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1140/2254] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:25:32 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:33.091005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a3c09-6508-4e6c-8a67-94265fa5c28c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:33.101724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a3c09-6508-4e6c-8a67-94265fa5c28c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:33.106628 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ca519-03e7-4ea7-b669-b52e2bdf69a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:33.107267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca519-03e7-4ea7-b669-b52e2bdf69a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:33.107543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca519-03e7-4ea7-b669-b52e2bdf69a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:33.107813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca519-03e7-4ea7-b669-b52e2bdf69a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:33.108456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ca519-03e7-4ea7-b669-b52e2bdf69a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:33.110087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ca519-03e7-4ea7-b669-b52e2bdf69a3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:33.121308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1115/2255] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:33.133722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465e303-182d-4f92-b98d-c534f53112c5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:33.144933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465e303-182d-4f92-b98d-c534f53112c5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:33.151389 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983471e9-1bdb-4d8f-bf60-77ffc7994175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:33.151944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983471e9-1bdb-4d8f-bf60-77ffc7994175 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:33.152302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983471e9-1bdb-4d8f-bf60-77ffc7994175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:33.152651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983471e9-1bdb-4d8f-bf60-77ffc7994175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:33.153503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983471e9-1bdb-4d8f-bf60-77ffc7994175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:33.155358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983471e9-1bdb-4d8f-bf60-77ffc7994175 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:33.167870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1141/2256] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:33.172116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ca519-03e7-4ea7-b669-b52e2bdf69a3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:33.183126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ca519-03e7-4ea7-b669-b52e2bdf69a3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:33.189541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d471de6-3544-4f7f-a59f-9ea9717a1ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:33.190226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d471de6-3544-4f7f-a59f-9ea9717a1ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:33.190496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d471de6-3544-4f7f-a59f-9ea9717a1ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:33.193967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d471de6-3544-4f7f-a59f-9ea9717a1ee0 admin admin] PATH_INFO: `/v3/projects/25f88db9a22c4436ad47f77cf02c0082/users/78af7eb996c947aba620a1af4c716062/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:33.213443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d471de6-3544-4f7f-a59f-9ea9717a1ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f88db9a22c4436ad47f77cf02c0082, user_id=78af7eb996c947aba620a1af4c716062, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:33.216237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d471de6-3544-4f7f-a59f-9ea9717a1ee0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:33.320471 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1116/2257] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:33 2022] PUT /identity/v3/projects/25f88db9a22c4436ad47f77cf02c0082/users/78af7eb996c947aba620a1af4c716062/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:33.331748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2185661-4c01-4cb9-b538-3677c1d7a11c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:33.332028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2185661-4c01-4cb9-b538-3677c1d7a11c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:33.332317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2185661-4c01-4cb9-b538-3677c1d7a11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:33.362581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a2185661-4c01-4cb9-b538-3677c1d7a11c None None] MFA Rules not processed for user `78af7eb996c947aba620a1af4c716062`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:33.363842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a2185661-4c01-4cb9-b538-3677c1d7a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:33.433888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1142/2258] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:33.438379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d471de6-3544-4f7f-a59f-9ea9717a1ee0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:33.478014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:33.507823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d471de6-3544-4f7f-a59f-9ea9717a1ee0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:33.512644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097966c-630c-4bba-9763-f0327498602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:33.513261 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097966c-630c-4bba-9763-f0327498602c admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:33.513573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097966c-630c-4bba-9763-f0327498602c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:33.513846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097966c-630c-4bba-9763-f0327498602c admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:33.514475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097966c-630c-4bba-9763-f0327498602c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:33.516402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097966c-630c-4bba-9763-f0327498602c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:33.642302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1117/2259] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:33 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:33.642965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2185661-4c01-4cb9-b538-3677c1d7a11c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:33.656186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2185661-4c01-4cb9-b538-3677c1d7a11c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:33.716869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:33.746974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5faaa-badf-4320-9ffe-6bf604cd453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:33.747660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5faaa-badf-4320-9ffe-6bf604cd453f admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:33.747969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5faaa-badf-4320-9ffe-6bf604cd453f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:33.748237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5faaa-badf-4320-9ffe-6bf604cd453f admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:33.749166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5faaa-badf-4320-9ffe-6bf604cd453f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:33.751131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5faaa-badf-4320-9ffe-6bf604cd453f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:33.852452 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1143/2260] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:25:33 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:33.856368 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097966c-630c-4bba-9763-f0327498602c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:33.867292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097966c-630c-4bba-9763-f0327498602c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:33.871744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1cf2a-4491-4629-90dc-bbaad82495f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:33.872331 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1cf2a-4491-4629-90dc-bbaad82495f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:33.872603 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1cf2a-4491-4629-90dc-bbaad82495f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:33.872911 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1cf2a-4491-4629-90dc-bbaad82495f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:33.873603 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1cf2a-4491-4629-90dc-bbaad82495f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:33.875183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1cf2a-4491-4629-90dc-bbaad82495f6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:33.886064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1118/2261] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:33.890412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5faaa-badf-4320-9ffe-6bf604cd453f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:33.900407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5faaa-badf-4320-9ffe-6bf604cd453f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:33.905716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb7442-4e6e-4a6c-b89a-59c5662cb1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:33.906391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb7442-4e6e-4a6c-b89a-59c5662cb1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:33.906664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb7442-4e6e-4a6c-b89a-59c5662cb1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:33.906931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb7442-4e6e-4a6c-b89a-59c5662cb1b4 admin admin] PATH_INFO: `/v3/projects/015beee51fd841b38c0ce6019891134e/users/00dd33a62701452389aab2239dc6b004/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:33.923160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb7442-4e6e-4a6c-b89a-59c5662cb1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015beee51fd841b38c0ce6019891134e, user_id=00dd33a62701452389aab2239dc6b004, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:33.925821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb7442-4e6e-4a6c-b89a-59c5662cb1b4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:33.995030 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1144/2262] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:33 2022] PUT /identity/v3/projects/015beee51fd841b38c0ce6019891134e/users/00dd33a62701452389aab2239dc6b004/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:33.999096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1cf2a-4491-4629-90dc-bbaad82495f6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:34.010365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1cf2a-4491-4629-90dc-bbaad82495f6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:34.066482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b783182-8835-4e8d-8787-07d50fe18a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:34.067083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783182-8835-4e8d-8787-07d50fe18a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:34.067398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783182-8835-4e8d-8787-07d50fe18a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:34.067671 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783182-8835-4e8d-8787-07d50fe18a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:34.069131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b783182-8835-4e8d-8787-07d50fe18a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:34.070868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b783182-8835-4e8d-8787-07d50fe18a8f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:34.086826 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1119/2263] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:34.091748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb7442-4e6e-4a6c-b89a-59c5662cb1b4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:34.103003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb7442-4e6e-4a6c-b89a-59c5662cb1b4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:34.107740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c130ef7-f666-4c1d-9393-9200aa3aff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:34.109318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130ef7-f666-4c1d-9393-9200aa3aff66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:34.109318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130ef7-f666-4c1d-9393-9200aa3aff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:34.109318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130ef7-f666-4c1d-9393-9200aa3aff66 admin admin] PATH_INFO: `/v3/projects/015beee51fd841b38c0ce6019891134e/users/00dd33a62701452389aab2239dc6b004/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:34.110994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c130ef7-f666-4c1d-9393-9200aa3aff66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015beee51fd841b38c0ce6019891134e, user_id=00dd33a62701452389aab2239dc6b004, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:34.113762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c130ef7-f666-4c1d-9393-9200aa3aff66 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:34.125647 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1145/2264] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:34 2022] PUT /identity/v3/projects/015beee51fd841b38c0ce6019891134e/users/00dd33a62701452389aab2239dc6b004/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:34.136389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025311a-ac4d-48eb-8460-0f1a2bd3133a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:34.136677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025311a-ac4d-48eb-8460-0f1a2bd3133a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:34.136950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025311a-ac4d-48eb-8460-0f1a2bd3133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:34.166347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7025311a-ac4d-48eb-8460-0f1a2bd3133a None None] MFA Rules not processed for user `00dd33a62701452389aab2239dc6b004`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:34.167633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7025311a-ac4d-48eb-8460-0f1a2bd3133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:34.243239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1120/2265] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:34.260484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c130ef7-f666-4c1d-9393-9200aa3aff66 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:34.262296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5c130ef7-f666-4c1d-9393-9200aa3aff66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:34.320288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c130ef7-f666-4c1d-9393-9200aa3aff66 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:34.323912 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeea7f0-5174-4b30-97c7-b38eab1bec73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:34.324503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeea7f0-5174-4b30-97c7-b38eab1bec73 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:34.324775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeea7f0-5174-4b30-97c7-b38eab1bec73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:34.325040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeea7f0-5174-4b30-97c7-b38eab1bec73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:34.334131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeea7f0-5174-4b30-97c7-b38eab1bec73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:34.335551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeea7f0-5174-4b30-97c7-b38eab1bec73 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:34.344930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1146/2266] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:34.402946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5972524-47b5-4bfa-919f-924738d6b769 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:34.403229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5972524-47b5-4bfa-919f-924738d6b769 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:34.403497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5972524-47b5-4bfa-919f-924738d6b769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:34.423986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f5972524-47b5-4bfa-919f-924738d6b769 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:34.425109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f5972524-47b5-4bfa-919f-924738d6b769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:34.446029 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:34.487709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1121/2267] 10.222.0.62 () {58 vars in 1016 bytes} [Wed Aug 17 16:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:34.520967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeea7f0-5174-4b30-97c7-b38eab1bec73 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:34.523290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aaeea7f0-5174-4b30-97c7-b38eab1bec73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:34.601850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeea7f0-5174-4b30-97c7-b38eab1bec73 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:34.608007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e8ed1-ef10-4268-bc33-11664cbfe0f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:34.608650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e8ed1-ef10-4268-bc33-11664cbfe0f3 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:34.608925 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e8ed1-ef10-4268-bc33-11664cbfe0f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:34.609196 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e8ed1-ef10-4268-bc33-11664cbfe0f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:34.618944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e8ed1-ef10-4268-bc33-11664cbfe0f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:34.624735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e8ed1-ef10-4268-bc33-11664cbfe0f3 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:34.631743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1147/2268] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:35.808892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5972524-47b5-4bfa-919f-924738d6b769 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:35.821220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5972524-47b5-4bfa-919f-924738d6b769 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:35.825934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:35.826570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:35.826848 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:35.827118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] PATH_INFO: `/v3/users/78af7eb996c947aba620a1af4c716062` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:35.828272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78af7eb996c947aba620a1af4c716062)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:35.830226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:36.016043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78af7eb996c947aba620a1af4c716062'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:36.016764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78af7eb996c947aba620a1af4c716062'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:36.025110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78af7eb996c947aba620a1af4c716062'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:36.039152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78af7eb996c947aba620a1af4c716062'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:36.097653 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78af7eb996c947aba620a1af4c716062'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:36.116452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1122/2269] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:35 2022] DELETE /identity/v3/users/78af7eb996c947aba620a1af4c716062 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:36.122860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6b64c-9e5a-4c85-a161-0e05d4864aa9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:36.122860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6b64c-9e5a-4c85-a161-0e05d4864aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:36.122860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6b64c-9e5a-4c85-a161-0e05d4864aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:36.138883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-18a6b64c-9e5a-4c85-a161-0e05d4864aa9 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:36.139892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-18a6b64c-9e5a-4c85-a161-0e05d4864aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:36.146008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:36.209787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1148/2270] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:36.228121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:36.229689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:36.297223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6c9df-c367-4a52-a8da-3de784725270 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:36.303124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e6a42-c19f-41f8-a899-9175d359aaf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:36.303930 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e6a42-c19f-41f8-a899-9175d359aaf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:36.304221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e6a42-c19f-41f8-a899-9175d359aaf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:36.304473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e6a42-c19f-41f8-a899-9175d359aaf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:36.314211 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e6a42-c19f-41f8-a899-9175d359aaf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:36.315690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e6a42-c19f-41f8-a899-9175d359aaf3 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:36.325866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1123/2271] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:25:36.738643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6b64c-9e5a-4c85-a161-0e05d4864aa9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:36.742769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-18a6b64c-9e5a-4c85-a161-0e05d4864aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:36.760649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6b64c-9e5a-4c85-a161-0e05d4864aa9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:36.765309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:36.765992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:36.766272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:36.766541 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] PATH_INFO: `/v3/projects/25f88db9a22c4436ad47f77cf02c0082` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:36.767773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f88db9a22c4436ad47f77cf02c0082)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:36.769813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:36.863282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f88db9a22c4436ad47f77cf02c0082', 'request_id': 'req-1ddfdc53-6b34-414f-acdd-1c7558735719'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:36.869708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f88db9a22c4436ad47f77cf02c0082', 'request_id': 'req-1ddfdc53-6b34-414f-acdd-1c7558735719'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:36.875870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f88db9a22c4436ad47f77cf02c0082', 'request_id': 'req-1ddfdc53-6b34-414f-acdd-1c7558735719'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:36.938632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] The token cache is being invalidate because project 25f88db9a22c4436ad47f77cf02c0082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:36.938957 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:36.939578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:36.941357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1149/2272] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:36 2022] DELETE /identity/v3/projects/25f88db9a22c4436ad47f77cf02c0082 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:36.946314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e6a42-c19f-41f8-a899-9175d359aaf3 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:36.958696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e6a42-c19f-41f8-a899-9175d359aaf3 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:36.999514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:37.016070 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95fb5a-5c1c-4f5a-baa9-20d566bfe28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:37.016695 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95fb5a-5c1c-4f5a-baa9-20d566bfe28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:37.016968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95fb5a-5c1c-4f5a-baa9-20d566bfe28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:37.017234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95fb5a-5c1c-4f5a-baa9-20d566bfe28f admin admin] PATH_INFO: `/v3/users/00dd33a62701452389aab2239dc6b004` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:37.018372 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95fb5a-5c1c-4f5a-baa9-20d566bfe28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00dd33a62701452389aab2239dc6b004)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:37.020315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95fb5a-5c1c-4f5a-baa9-20d566bfe28f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:37.170959 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8e95fb5a-5c1c-4f5a-baa9-20d566bfe28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00dd33a62701452389aab2239dc6b004'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:37.171752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8e95fb5a-5c1c-4f5a-baa9-20d566bfe28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00dd33a62701452389aab2239dc6b004'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:37.179690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8e95fb5a-5c1c-4f5a-baa9-20d566bfe28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00dd33a62701452389aab2239dc6b004'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:37.192067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8e95fb5a-5c1c-4f5a-baa9-20d566bfe28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00dd33a62701452389aab2239dc6b004'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:37.320267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8e95fb5a-5c1c-4f5a-baa9-20d566bfe28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00dd33a62701452389aab2239dc6b004'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:37.327469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1124/2273] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:36 2022] DELETE /identity/v3/users/00dd33a62701452389aab2239dc6b004 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:37.980604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:37.981959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:37.997609 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfdc53-6b34-414f-acdd-1c7558735719 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:38.058830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:38.059463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:38.059736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:38.060000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] PATH_INFO: `/v3/projects/015beee51fd841b38c0ce6019891134e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:38.061228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=015beee51fd841b38c0ce6019891134e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:38.063327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:38.220960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:38.229887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015beee51fd841b38c0ce6019891134e', 'request_id': 'req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:38.235576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015beee51fd841b38c0ce6019891134e', 'request_id': 'req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:38.242252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015beee51fd841b38c0ce6019891134e', 'request_id': 'req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:38.354183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] The token cache is being invalidate because project 015beee51fd841b38c0ce6019891134e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:38.354453 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:38.355086 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3ffa4060-3c6b-4dfd-9d66-0320097ef4a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:38.356599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1150/2274] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:37 2022] DELETE /identity/v3/projects/015beee51fd841b38c0ce6019891134e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:38.361708 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bef19-625b-4a88-808f-24bcde288e10 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:38.362203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bef19-625b-4a88-808f-24bcde288e10 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:38.362203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bef19-625b-4a88-808f-24bcde288e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:38.382939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-643bef19-625b-4a88-808f-24bcde288e10 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:38.387704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-643bef19-625b-4a88-808f-24bcde288e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:38.457425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1125/2275] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:38.465184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a9c02-a914-49d8-a4b4-c579d7240b39 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:38.465598 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a9c02-a914-49d8-a4b4-c579d7240b39 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:38.466108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a9c02-a914-49d8-a4b4-c579d7240b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:38.485927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-031a9c02-a914-49d8-a4b4-c579d7240b39 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:38.487179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-031a9c02-a914-49d8-a4b4-c579d7240b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:38.495971 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1151/2276] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:38.500203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bef19-625b-4a88-808f-24bcde288e10 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:38.511346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bef19-625b-4a88-808f-24bcde288e10 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:38.516281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ecd23-c74b-464e-9b10-43045e143ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:38.516895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ecd23-c74b-464e-9b10-43045e143ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:38.517171 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ecd23-c74b-464e-9b10-43045e143ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:38.517500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ecd23-c74b-464e-9b10-43045e143ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:38.518181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ecd23-c74b-464e-9b10-43045e143ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:25:38.518491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ecd23-c74b-464e-9b10-43045e143ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:38.520151 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ecd23-c74b-464e-9b10-43045e143ffd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:38.537315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1126/2277] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:25:38.538796 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a9c02-a914-49d8-a4b4-c579d7240b39 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:38.549520 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a9c02-a914-49d8-a4b4-c579d7240b39 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:38.558496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556d98-6175-495e-a99d-1a3154a81f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:38.559532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556d98-6175-495e-a99d-1a3154a81f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:38.559861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556d98-6175-495e-a99d-1a3154a81f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:38.560131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556d98-6175-495e-a99d-1a3154a81f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:38.561012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64556d98-6175-495e-a99d-1a3154a81f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:38.564027 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64556d98-6175-495e-a99d-1a3154a81f1b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:38.658383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1152/2278] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:38 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:38.663928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ecd23-c74b-464e-9b10-43045e143ffd admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:38.678496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ecd23-c74b-464e-9b10-43045e143ffd admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:38.737876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:38.753815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c7a8e-07a3-48d2-a2a7-6a03cdbfa69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:38.754530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c7a8e-07a3-48d2-a2a7-6a03cdbfa69e admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:38.754873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c7a8e-07a3-48d2-a2a7-6a03cdbfa69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:38.755217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c7a8e-07a3-48d2-a2a7-6a03cdbfa69e admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:38.756467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c7a8e-07a3-48d2-a2a7-6a03cdbfa69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:38.759354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c7a8e-07a3-48d2-a2a7-6a03cdbfa69e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:38.863976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1127/2279] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:25:38 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:38.868818 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556d98-6175-495e-a99d-1a3154a81f1b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:38.881467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556d98-6175-495e-a99d-1a3154a81f1b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:38.886366 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ccfc6-9f41-4793-abc5-92328836521f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:38.889892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ccfc6-9f41-4793-abc5-92328836521f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:38.889892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ccfc6-9f41-4793-abc5-92328836521f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:38.889892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ccfc6-9f41-4793-abc5-92328836521f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:38.889892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ccfc6-9f41-4793-abc5-92328836521f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:38.890204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ccfc6-9f41-4793-abc5-92328836521f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:38.910766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1153/2280] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:25:38.912347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c7a8e-07a3-48d2-a2a7-6a03cdbfa69e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:38.922879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c7a8e-07a3-48d2-a2a7-6a03cdbfa69e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:38.929325 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716a660-8073-4678-a0d7-ccec8e8b617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:38.930639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a660-8073-4678-a0d7-ccec8e8b617a admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:38.930639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a660-8073-4678-a0d7-ccec8e8b617a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:38.930639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a660-8073-4678-a0d7-ccec8e8b617a admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:38.931449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716a660-8073-4678-a0d7-ccec8e8b617a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:38.933104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716a660-8073-4678-a0d7-ccec8e8b617a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:38.945109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1128/2281] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:25:38.957306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ccfc6-9f41-4793-abc5-92328836521f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:38.960345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ccfc6-9f41-4793-abc5-92328836521f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:38.965157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a48da-2b90-4b94-b812-d27e003c9045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:38.966021 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a48da-2b90-4b94-b812-d27e003c9045 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:38.966342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a48da-2b90-4b94-b812-d27e003c9045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:38.966616 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a48da-2b90-4b94-b812-d27e003c9045 admin admin] PATH_INFO: `/v3/projects/93901add68c04b00b696a1dfc48372d5/users/aa4d98e077c4404eaa55aa19a9bb8895/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:38.983792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a48da-2b90-4b94-b812-d27e003c9045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93901add68c04b00b696a1dfc48372d5, user_id=aa4d98e077c4404eaa55aa19a9bb8895, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:38.987654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a48da-2b90-4b94-b812-d27e003c9045 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:39.075183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1154/2282] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:38 2022] PUT /identity/v3/projects/93901add68c04b00b696a1dfc48372d5/users/aa4d98e077c4404eaa55aa19a9bb8895/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:25:39.087881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b6d1b-e5ea-4642-b1c0-b0f7260fc254 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:39.088302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b6d1b-e5ea-4642-b1c0-b0f7260fc254 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:39.091568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b6d1b-e5ea-4642-b1c0-b0f7260fc254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:39.124929 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2e3b6d1b-e5ea-4642-b1c0-b0f7260fc254 None None] MFA Rules not processed for user `aa4d98e077c4404eaa55aa19a9bb8895`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:39.126085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2e3b6d1b-e5ea-4642-b1c0-b0f7260fc254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:39.190297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1129/2283] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:39.201645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a48da-2b90-4b94-b812-d27e003c9045 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:39.203349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-df1a48da-2b90-4b94-b812-d27e003c9045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:39.263131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a48da-2b90-4b94-b812-d27e003c9045 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:39.267086 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3bbc-1e68-467a-9260-857a1de12a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:39.267738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3bbc-1e68-467a-9260-857a1de12a27 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:39.268343 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3bbc-1e68-467a-9260-857a1de12a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:39.268613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a3bbc-1e68-467a-9260-857a1de12a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:39.277582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a3bbc-1e68-467a-9260-857a1de12a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:39.278992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a3bbc-1e68-467a-9260-857a1de12a27 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:39.288465 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1155/2284] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:39.894362 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644468e2-a4e8-41e9-be62-e741c247dc7f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:39.894824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644468e2-a4e8-41e9-be62-e741c247dc7f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:39.895028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644468e2-a4e8-41e9-be62-e741c247dc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:39.915883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-644468e2-a4e8-41e9-be62-e741c247dc7f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:39.917085 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-644468e2-a4e8-41e9-be62-e741c247dc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:39.980850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1130/2285] 10.222.0.62 () {58 vars in 1016 bytes} [Wed Aug 17 16:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:40.010674 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3bbc-1e68-467a-9260-857a1de12a27 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:40.012209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b79a3bbc-1e68-467a-9260-857a1de12a27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:40.081498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:40.088117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a3bbc-1e68-467a-9260-857a1de12a27 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:40.093632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c3e0d-9474-491c-9430-e0bcb397aab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:40.094231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c3e0d-9474-491c-9430-e0bcb397aab2 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:40.094505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c3e0d-9474-491c-9430-e0bcb397aab2 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:40.094775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c3e0d-9474-491c-9430-e0bcb397aab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:40.104176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c3e0d-9474-491c-9430-e0bcb397aab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:40.105816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c3e0d-9474-491c-9430-e0bcb397aab2 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:40.116344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1156/2286] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:45.614458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d16ad-c0d5-4d15-afa7-92cf7bec8b7d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:45.615093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d16ad-c0d5-4d15-afa7-92cf7bec8b7d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:45.615093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d16ad-c0d5-4d15-afa7-92cf7bec8b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:45.635402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c79d16ad-c0d5-4d15-afa7-92cf7bec8b7d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:45.637814 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c79d16ad-c0d5-4d15-afa7-92cf7bec8b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:45.644415 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1131/2287] 10.222.0.62 () {58 vars in 1016 bytes} [Wed Aug 17 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:45.668380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c3e0d-9474-491c-9430-e0bcb397aab2 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:45.680125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c3e0d-9474-491c-9430-e0bcb397aab2 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:45.685572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788e2b4-f1d1-4471-b34b-2d4afde84e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:45.686237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788e2b4-f1d1-4471-b34b-2d4afde84e8a service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:45.686507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788e2b4-f1d1-4471-b34b-2d4afde84e8a service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:45.686772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788e2b4-f1d1-4471-b34b-2d4afde84e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:45.695694 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788e2b4-f1d1-4471-b34b-2d4afde84e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:45.697387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788e2b4-f1d1-4471-b34b-2d4afde84e8a service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:45.707444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1157/2288] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:47.959178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b150a-257b-49f3-ab7e-dbac12267001 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:47.959686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b150a-257b-49f3-ab7e-dbac12267001 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:47.959790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b150a-257b-49f3-ab7e-dbac12267001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:47.981463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5f9b150a-257b-49f3-ab7e-dbac12267001 None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:47.986787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5f9b150a-257b-49f3-ab7e-dbac12267001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:48.029618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:48.041144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1132/2289] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:25:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:48.083824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788e2b4-f1d1-4471-b34b-2d4afde84e8a service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:48.085199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f788e2b4-f1d1-4471-b34b-2d4afde84e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:48.155534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788e2b4-f1d1-4471-b34b-2d4afde84e8a service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:48.161099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ee349-61b5-4eb3-835a-26b6ce55d99d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:48.161737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ee349-61b5-4eb3-835a-26b6ce55d99d service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:48.162014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ee349-61b5-4eb3-835a-26b6ce55d99d service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:48.162626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ee349-61b5-4eb3-835a-26b6ce55d99d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:48.171378 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ee349-61b5-4eb3-835a-26b6ce55d99d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:48.173069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ee349-61b5-4eb3-835a-26b6ce55d99d service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:48.190816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1158/2290] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:25:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:25:49.786786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d19ff-9634-4a92-b7b4-ccb5047db629 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:49.787758 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d19ff-9634-4a92-b7b4-ccb5047db629 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:49.788033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d19ff-9634-4a92-b7b4-ccb5047db629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:49.808331 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f94d19ff-9634-4a92-b7b4-ccb5047db629 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:49.809888 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f94d19ff-9634-4a92-b7b4-ccb5047db629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:49.824483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1133/2291] 10.222.0.62 () {58 vars in 1016 bytes} [Wed Aug 17 16:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:49.861608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ee349-61b5-4eb3-835a-26b6ce55d99d service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:49.865803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fa1ee349-61b5-4eb3-835a-26b6ce55d99d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:49.894881 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ee349-61b5-4eb3-835a-26b6ce55d99d service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:49.903449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4f7dd-107a-40f2-858d-d5479ce5c60e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:49.905263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f7dd-107a-40f2-858d-d5479ce5c60e service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:49.906595 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f7dd-107a-40f2-858d-d5479ce5c60e service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:49.907135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4f7dd-107a-40f2-858d-d5479ce5c60e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:49.922873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4f7dd-107a-40f2-858d-d5479ce5c60e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:49.928663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4f7dd-107a-40f2-858d-d5479ce5c60e service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:49.968363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1159/2292] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:54.175704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfc80a-ef88-48a1-84c4-99cb23952df2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:54.176414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfc80a-ef88-48a1-84c4-99cb23952df2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:54.176414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfc80a-ef88-48a1-84c4-99cb23952df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:54.203739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3fcfc80a-ef88-48a1-84c4-99cb23952df2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:54.205050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3fcfc80a-ef88-48a1-84c4-99cb23952df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:54.213572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1134/2293] 10.222.0.62 () {58 vars in 1016 bytes} [Wed Aug 17 16:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:54.239087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4f7dd-107a-40f2-858d-d5479ce5c60e service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:54.251531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4f7dd-107a-40f2-858d-d5479ce5c60e service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:54.267233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a822f-3654-487a-b21b-befd44854aa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:54.267866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a822f-3654-487a-b21b-befd44854aa5 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:54.268141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a822f-3654-487a-b21b-befd44854aa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:54.268428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a822f-3654-487a-b21b-befd44854aa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:54.285416 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a822f-3654-487a-b21b-befd44854aa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:54.285416 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a822f-3654-487a-b21b-befd44854aa5 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:54.297403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1160/2294] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:56.746564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfc80a-ef88-48a1-84c4-99cb23952df2 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:56.757496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfc80a-ef88-48a1-84c4-99cb23952df2 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:56.762456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:56.763093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:56.763374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:56.763642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] PATH_INFO: `/v3/users/aa4d98e077c4404eaa55aa19a9bb8895` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:56.764955 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4d98e077c4404eaa55aa19a9bb8895)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:56.766963 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:56.932680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4d98e077c4404eaa55aa19a9bb8895'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:56.938071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4d98e077c4404eaa55aa19a9bb8895'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:56.958915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4d98e077c4404eaa55aa19a9bb8895'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:56.992713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4d98e077c4404eaa55aa19a9bb8895'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:57.085854 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4d98e077c4404eaa55aa19a9bb8895'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:57.101696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1135/2295] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:25:56 2022] DELETE /identity/v3/users/aa4d98e077c4404eaa55aa19a9bb8895 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:57.103477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02755b81-0750-472f-b137-3dec51d4121f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:57.103967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02755b81-0750-472f-b137-3dec51d4121f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:57.104504 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02755b81-0750-472f-b137-3dec51d4121f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:57.126499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-02755b81-0750-472f-b137-3dec51d4121f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:57.127902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-02755b81-0750-472f-b137-3dec51d4121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:57.209329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1161/2296] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:57.221414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:57.223606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:57.306467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68218c-d126-4f0d-b499-c3915f4c295e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:57.310942 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf29094-cb1b-48a5-8171-7ac5db1642dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:57.311867 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29094-cb1b-48a5-8171-7ac5db1642dc service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:57.312249 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29094-cb1b-48a5-8171-7ac5db1642dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:57.312618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29094-cb1b-48a5-8171-7ac5db1642dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:57.324860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf29094-cb1b-48a5-8171-7ac5db1642dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:57.326519 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf29094-cb1b-48a5-8171-7ac5db1642dc service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:57.338229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1136/2297] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:25:58.217148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02755b81-0750-472f-b137-3dec51d4121f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:58.217148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-02755b81-0750-472f-b137-3dec51d4121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:58.226265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02755b81-0750-472f-b137-3dec51d4121f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:58.232160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:58.232932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:58.233303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:58.233700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] PATH_INFO: `/v3/projects/93901add68c04b00b696a1dfc48372d5` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:58.234928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=93901add68c04b00b696a1dfc48372d5)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:58.236954 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:58.428498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:58.440202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93901add68c04b00b696a1dfc48372d5', 'request_id': 'req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:58.464187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93901add68c04b00b696a1dfc48372d5', 'request_id': 'req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:58.473022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93901add68c04b00b696a1dfc48372d5', 'request_id': 'req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:58.544552 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55b652-e57c-4404-b329-9a78cfe4e15e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:58.545183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55b652-e57c-4404-b329-9a78cfe4e15e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:58.545183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55b652-e57c-4404-b329-9a78cfe4e15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:58.561456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] The token cache is being invalidate because project 93901add68c04b00b696a1dfc48372d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:25:58.562285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:58.562763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5e43fc1e-90cc-46e7-a358-187f5fe72f4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:25:58.564676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1162/2298] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:25:58 2022] DELETE /identity/v3/projects/93901add68c04b00b696a1dfc48372d5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:58.569039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f47b68-f7ac-469e-b6ba-6dbad5596e02 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:58.569456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f47b68-f7ac-469e-b6ba-6dbad5596e02 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:58.569804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f47b68-f7ac-469e-b6ba-6dbad5596e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:58.570811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9a55b652-e57c-4404-b329-9a78cfe4e15e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:58.572106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9a55b652-e57c-4404-b329-9a78cfe4e15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:58.598564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-32f47b68-f7ac-469e-b6ba-6dbad5596e02 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:58.600162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-32f47b68-f7ac-469e-b6ba-6dbad5596e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:58.639442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:58.655145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1137/2299] 10.222.0.62 () {58 vars in 1016 bytes} [Wed Aug 17 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:25:58.675709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1163/2300] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:25:58.679856 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0abc97-76e1-42ae-986d-e40b6059007e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:58.680701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0abc97-76e1-42ae-986d-e40b6059007e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:58.680972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0abc97-76e1-42ae-986d-e40b6059007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:58.682399 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f47b68-f7ac-469e-b6ba-6dbad5596e02 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:58.685147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-32f47b68-f7ac-469e-b6ba-6dbad5596e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:58.712938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-cf0abc97-76e1-42ae-986d-e40b6059007e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:58.714205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cf0abc97-76e1-42ae-986d-e40b6059007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:58.732325 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1138/2301] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:58.736293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0abc97-76e1-42ae-986d-e40b6059007e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:58.749529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0abc97-76e1-42ae-986d-e40b6059007e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:58.756922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2117a-a3fb-4f06-9e75-03565aa54803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:58.761692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2117a-a3fb-4f06-9e75-03565aa54803 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:58.761692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2117a-a3fb-4f06-9e75-03565aa54803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:58.761692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2117a-a3fb-4f06-9e75-03565aa54803 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:58.761692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2117a-a3fb-4f06-9e75-03565aa54803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:25:58.761692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2117a-a3fb-4f06-9e75-03565aa54803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:58.762323 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2117a-a3fb-4f06-9e75-03565aa54803 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:58.783178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1139/2302] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:25:58.787861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2117a-a3fb-4f06-9e75-03565aa54803 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:58.801818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2117a-a3fb-4f06-9e75-03565aa54803 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:58.808256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de324f8-f326-4971-aab4-caa18cbc042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:58.808877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de324f8-f326-4971-aab4-caa18cbc042d admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:58.809156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de324f8-f326-4971-aab4-caa18cbc042d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:58.809459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de324f8-f326-4971-aab4-caa18cbc042d admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:58.810091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de324f8-f326-4971-aab4-caa18cbc042d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:58.812156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de324f8-f326-4971-aab4-caa18cbc042d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:58.813336 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f47b68-f7ac-469e-b6ba-6dbad5596e02 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:58.828133 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777edee-3a6a-4078-abc1-d48be05943dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:58.828773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777edee-3a6a-4078-abc1-d48be05943dc service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:58.829048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777edee-3a6a-4078-abc1-d48be05943dc service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:58.829317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777edee-3a6a-4078-abc1-d48be05943dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:58.840107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777edee-3a6a-4078-abc1-d48be05943dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:58.841785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777edee-3a6a-4078-abc1-d48be05943dc service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:58.855136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1164/2303] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:58.908818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1140/2304] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:25:58 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:25:58.912226 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777edee-3a6a-4078-abc1-d48be05943dc service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:58.922879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777edee-3a6a-4078-abc1-d48be05943dc service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:58.979933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:58.995676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3b00d-dada-41fb-b280-79c3a3ae9490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:58.996310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3b00d-dada-41fb-b280-79c3a3ae9490 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:58.996625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3b00d-dada-41fb-b280-79c3a3ae9490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:58.996844 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3b00d-dada-41fb-b280-79c3a3ae9490 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:58.998706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3b00d-dada-41fb-b280-79c3a3ae9490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:59.000156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3b00d-dada-41fb-b280-79c3a3ae9490 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:59.091975 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1165/2305] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:25:58 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:25:59.096204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de324f8-f326-4971-aab4-caa18cbc042d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:59.108329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de324f8-f326-4971-aab4-caa18cbc042d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:59.114087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fd31c-ecf3-4b36-b2f1-4d7ace1088a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:59.114948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fd31c-ecf3-4b36-b2f1-4d7ace1088a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:59.115292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fd31c-ecf3-4b36-b2f1-4d7ace1088a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:59.115633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fd31c-ecf3-4b36-b2f1-4d7ace1088a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:59.116369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fd31c-ecf3-4b36-b2f1-4d7ace1088a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:59.118193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fd31c-ecf3-4b36-b2f1-4d7ace1088a9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:59.129772 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1141/2306] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:25:59.134047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3b00d-dada-41fb-b280-79c3a3ae9490 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:59.144633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3b00d-dada-41fb-b280-79c3a3ae9490 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:59.150065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6bf58-6697-4a86-bf36-09c9ad8228fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:59.150762 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bf58-6697-4a86-bf36-09c9ad8228fb admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:59.151039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bf58-6697-4a86-bf36-09c9ad8228fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:59.151311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bf58-6697-4a86-bf36-09c9ad8228fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:59.152047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6bf58-6697-4a86-bf36-09c9ad8228fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:59.154758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6bf58-6697-4a86-bf36-09c9ad8228fb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:59.169405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1166/2307] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:25:59.171152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fd31c-ecf3-4b36-b2f1-4d7ace1088a9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:59.182997 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fd31c-ecf3-4b36-b2f1-4d7ace1088a9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:59.190968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e2918-0a7d-4116-b960-c361ab7ed882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:59.191780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2918-0a7d-4116-b960-c361ab7ed882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:59.192068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2918-0a7d-4116-b960-c361ab7ed882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:59.192344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2918-0a7d-4116-b960-c361ab7ed882 admin admin] PATH_INFO: `/v3/projects/a04e107c921547a7b961a19b04c7dede/users/359f6de02d5e4abc952876a72d48b5fc/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:59.208002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e2918-0a7d-4116-b960-c361ab7ed882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04e107c921547a7b961a19b04c7dede, user_id=359f6de02d5e4abc952876a72d48b5fc, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:59.210745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e2918-0a7d-4116-b960-c361ab7ed882 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:59.383058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1142/2308] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:25:59 2022] PUT /identity/v3/projects/a04e107c921547a7b961a19b04c7dede/users/359f6de02d5e4abc952876a72d48b5fc/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:25:59.455663 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97f189-becb-4eb8-a19b-64f97bfbf63c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:59.457519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97f189-becb-4eb8-a19b-64f97bfbf63c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:59.458050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97f189-becb-4eb8-a19b-64f97bfbf63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:59.495852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ad97f189-becb-4eb8-a19b-64f97bfbf63c None None] MFA Rules not processed for user `359f6de02d5e4abc952876a72d48b5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:59.497052 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ad97f189-becb-4eb8-a19b-64f97bfbf63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:59.562277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1167/2309] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:25:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:59.574340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e2918-0a7d-4116-b960-c361ab7ed882 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:59.576054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-065e2918-0a7d-4116-b960-c361ab7ed882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:59.634360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e2918-0a7d-4116-b960-c361ab7ed882 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:59.638040 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1e150-b367-4a17-b629-b2cc8575ea52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:59.641591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1e150-b367-4a17-b629-b2cc8575ea52 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:59.641591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1e150-b367-4a17-b629-b2cc8575ea52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:59.641591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1e150-b367-4a17-b629-b2cc8575ea52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:59.647335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1e150-b367-4a17-b629-b2cc8575ea52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:59.648817 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1e150-b367-4a17-b629-b2cc8575ea52 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:59.657965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1143/2310] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:07.807917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5885e1-ebde-4d17-9d70-a674886edd30 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.808920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5885e1-ebde-4d17-9d70-a674886edd30 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.809347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5885e1-ebde-4d17-9d70-a674886edd30 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.811313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1168/2311] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 17 16:26:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:26:07.817173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00d8e-b333-4e76-b6b9-36a7f7622444 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.817712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00d8e-b333-4e76-b6b9-36a7f7622444 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.817892 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00d8e-b333-4e76-b6b9-36a7f7622444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.839873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-07c00d8e-b333-4e76-b6b9-36a7f7622444 None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:07.841807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-07c00d8e-b333-4e76-b6b9-36a7f7622444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:07.921452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1144/2312] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 17 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:07.946543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5885e1-ebde-4d17-9d70-a674886edd30 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:07.946543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1b5885e1-ebde-4d17-9d70-a674886edd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:08.029962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5885e1-ebde-4d17-9d70-a674886edd30 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:08.034489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9339d-709b-4962-a89c-d769eb241bd6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b8a5b38ac046ed8e8b98f0ecefb07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:08.035254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9339d-709b-4962-a89c-d769eb241bd6 service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.035636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9339d-709b-4962-a89c-d769eb241bd6 service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.036011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9339d-709b-4962-a89c-d769eb241bd6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.047735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9339d-709b-4962-a89c-d769eb241bd6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:08.049431 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9339d-709b-4962-a89c-d769eb241bd6 service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:08.062194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1169/2313] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:08.228480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc5af8-d79a-4496-9fc5-c528f520ad57 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.228682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc5af8-d79a-4496-9fc5-c528f520ad57 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.228972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc5af8-d79a-4496-9fc5-c528f520ad57 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.230349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1145/2314] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 17 16:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:26:08.235108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51221999-2a3f-49d9-afec-5185243cd117 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.235388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51221999-2a3f-49d9-afec-5185243cd117 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.235664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51221999-2a3f-49d9-afec-5185243cd117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.255406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-51221999-2a3f-49d9-afec-5185243cd117 None None] MFA Rules not processed for user `4ad54a22e6e747d9887c82bb62a923da`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:08.256602 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-51221999-2a3f-49d9-afec-5185243cd117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:08.289712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:08.307557 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1170/2315] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 17 16:26:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:08.319087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc5af8-d79a-4496-9fc5-c528f520ad57 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:08.320761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2ebc5af8-d79a-4496-9fc5-c528f520ad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:08.334535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc5af8-d79a-4496-9fc5-c528f520ad57 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:08.338021 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd4df9-2fb7-4a61-a714-a2d58ef87296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:08.338612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4df9-2fb7-4a61-a714-a2d58ef87296 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.338882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4df9-2fb7-4a61-a714-a2d58ef87296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.339143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4df9-2fb7-4a61-a714-a2d58ef87296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.346214 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd4df9-2fb7-4a61-a714-a2d58ef87296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:08.347687 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd4df9-2fb7-4a61-a714-a2d58ef87296 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:08.356583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1146/2316] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:08.440198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598509-282f-433f-9c5b-68a6e7f1e425 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.440483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598509-282f-433f-9c5b-68a6e7f1e425 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.440757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598509-282f-433f-9c5b-68a6e7f1e425 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.442164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1171/2317] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 17 16:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:26:08.448271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2402f2-2f2f-493a-bc29-17e676a6124c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.448561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2402f2-2f2f-493a-bc29-17e676a6124c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.448833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2402f2-2f2f-493a-bc29-17e676a6124c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.456562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:08.468534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9d2402f2-2f2f-493a-bc29-17e676a6124c None None] MFA Rules not processed for user `f99edbaee8504487863c6fa4b551c224`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:08.469776 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9d2402f2-2f2f-493a-bc29-17e676a6124c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:08.480050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1147/2318] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 17 16:26:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:08.490593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd598509-282f-433f-9c5b-68a6e7f1e425 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:08.502118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd598509-282f-433f-9c5b-68a6e7f1e425 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:08.505692 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ade7-079d-4fd6-9f85-540b2d90bcdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:08.506279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ade7-079d-4fd6-9f85-540b2d90bcdc service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.506548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ade7-079d-4fd6-9f85-540b2d90bcdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.506813 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ade7-079d-4fd6-9f85-540b2d90bcdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.516536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0ade7-079d-4fd6-9f85-540b2d90bcdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:08.517990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0ade7-079d-4fd6-9f85-540b2d90bcdc service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:08.528354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1172/2319] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:10.950621 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2402f2-2f2f-493a-bc29-17e676a6124c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:11.012187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2402f2-2f2f-493a-bc29-17e676a6124c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:11.016659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:11.017274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:11.017575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:11.017842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] PATH_INFO: `/v3/users/359f6de02d5e4abc952876a72d48b5fc` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:11.018937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359f6de02d5e4abc952876a72d48b5fc)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:11.020866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:11.216933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359f6de02d5e4abc952876a72d48b5fc'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:11.217653 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359f6de02d5e4abc952876a72d48b5fc'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:11.224473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359f6de02d5e4abc952876a72d48b5fc'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:11.236335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359f6de02d5e4abc952876a72d48b5fc'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:11.289578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359f6de02d5e4abc952876a72d48b5fc'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:11.296730 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1148/2320] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:26:10 2022] DELETE /identity/v3/users/359f6de02d5e4abc952876a72d48b5fc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:11.301235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22e21-772c-4e91-92b8-17ca549c2a2c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:11.301722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22e21-772c-4e91-92b8-17ca549c2a2c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:11.306442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22e21-772c-4e91-92b8-17ca549c2a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:11.321572 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-59e22e21-772c-4e91-92b8-17ca549c2a2c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:11.323512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-59e22e21-772c-4e91-92b8-17ca549c2a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:11.390160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1173/2321] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:26:11.406126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:11.407690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:11.485280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa40be-61a9-4377-83ec-3c8234eff8d1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:11.488911 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2e2b7-d835-46da-93f9-001170a9f9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:11.489570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2e2b7-d835-46da-93f9-001170a9f9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:11.489844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2e2b7-d835-46da-93f9-001170a9f9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:11.490105 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2e2b7-d835-46da-93f9-001170a9f9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:11.500498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2e2b7-d835-46da-93f9-001170a9f9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:11.502038 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2e2b7-d835-46da-93f9-001170a9f9d8 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:11.511771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1149/2322] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:26:11.987967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22e21-772c-4e91-92b8-17ca549c2a2c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:11.989567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-59e22e21-772c-4e91-92b8-17ca549c2a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:12.004129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22e21-772c-4e91-92b8-17ca549c2a2c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:12.008966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:12.009661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:12.009937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:12.010258 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] PATH_INFO: `/v3/projects/a04e107c921547a7b961a19b04c7dede` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:12.011437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04e107c921547a7b961a19b04c7dede)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:12.013385 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:12.158570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04e107c921547a7b961a19b04c7dede', 'request_id': 'req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:12.164038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04e107c921547a7b961a19b04c7dede', 'request_id': 'req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:12.171270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04e107c921547a7b961a19b04c7dede', 'request_id': 'req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:12.271291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] The token cache is being invalidate because project a04e107c921547a7b961a19b04c7dede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:26:12.271573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:12.272188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:12.273691 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1174/2323] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:26:11 2022] DELETE /identity/v3/projects/a04e107c921547a7b961a19b04c7dede => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:17.015315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3725-e16e-4124-918c-2935b47f391e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:17.016901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3725-e16e-4124-918c-2935b47f391e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:17.016901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3725-e16e-4124-918c-2935b47f391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:17.036027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-775f3725-e16e-4124-918c-2935b47f391e None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:17.039461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-775f3725-e16e-4124-918c-2935b47f391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:17.050294 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:17.095885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1150/2324] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:26:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:17.110036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:17.111534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:17.176830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:17.182987 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0885f0-a2ba-4db5-9bda-bcd451cf24a9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:17.188686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6d650-2dfd-46e1-8e20-1d170e0e91bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:17.189317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6d650-2dfd-46e1-8e20-1d170e0e91bd service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:17.189638 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6d650-2dfd-46e1-8e20-1d170e0e91bd service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:17.189905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6d650-2dfd-46e1-8e20-1d170e0e91bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:17.198387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6d650-2dfd-46e1-8e20-1d170e0e91bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:17.199959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6d650-2dfd-46e1-8e20-1d170e0e91bd service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:17.208675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1175/2325] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:26:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:26:20.564798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fd6ad-5ec7-4209-9082-bcc043dbab6a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:20.565429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fd6ad-5ec7-4209-9082-bcc043dbab6a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:20.565429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fd6ad-5ec7-4209-9082-bcc043dbab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:20.585831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-276fd6ad-5ec7-4209-9082-bcc043dbab6a None None] MFA Rules not processed for user `64c63d6be76f4441b6c40a4eb58c947c`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:20.587099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-276fd6ad-5ec7-4209-9082-bcc043dbab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:20.652189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1151/2326] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:26:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:27.512283 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:30.642834 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=42 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:36.371731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422015d-a8d2-4776-a792-cf13adadbeea None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:36.371731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422015d-a8d2-4776-a792-cf13adadbeea None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:36.371731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422015d-a8d2-4776-a792-cf13adadbeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:36.394763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d422015d-a8d2-4776-a792-cf13adadbeea None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:36.395976 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d422015d-a8d2-4776-a792-cf13adadbeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:36.404270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1176/2327] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 17 16:26:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:36.417820 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fd6ad-5ec7-4209-9082-bcc043dbab6a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:36.429901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fd6ad-5ec7-4209-9082-bcc043dbab6a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:36.435096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a7f6a-cefd-4447-ad61-07bed100ae05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:36.435725 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7f6a-cefd-4447-ad61-07bed100ae05 service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:36.436001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7f6a-cefd-4447-ad61-07bed100ae05 service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:36.436269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7f6a-cefd-4447-ad61-07bed100ae05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:36.445037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a7f6a-cefd-4447-ad61-07bed100ae05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:36.447326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a7f6a-cefd-4447-ad61-07bed100ae05 service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:36.456047 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1152/2328] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:26:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:26:43.923898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422015d-a8d2-4776-a792-cf13adadbeea None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:43.925341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d422015d-a8d2-4776-a792-cf13adadbeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:44.014298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422015d-a8d2-4776-a792-cf13adadbeea None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:44.019306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc938ec-3864-4616-a958-61d217ea24c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da5e1da2196b4ff399921809f40d3002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:44.019919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc938ec-3864-4616-a958-61d217ea24c0 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:44.020197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc938ec-3864-4616-a958-61d217ea24c0 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:44.020468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc938ec-3864-4616-a958-61d217ea24c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:44.022230 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6bc938ec-3864-4616-a958-61d217ea24c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:44.034768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc938ec-3864-4616-a958-61d217ea24c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:44.036360 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc938ec-3864-4616-a958-61d217ea24c0 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:44.047792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1177/2329] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:45.593459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0714ad-db74-450a-b167-dcc84cd72d55 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:45.593989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0714ad-db74-450a-b167-dcc84cd72d55 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:45.594089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0714ad-db74-450a-b167-dcc84cd72d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:45.613340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-cb0714ad-db74-450a-b167-dcc84cd72d55 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:45.614570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cb0714ad-db74-450a-b167-dcc84cd72d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:45.680857 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1153/2330] 10.222.0.62 () {58 vars in 1016 bytes} [Wed Aug 17 16:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:45.703186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc938ec-3864-4616-a958-61d217ea24c0 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:45.704776 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6bc938ec-3864-4616-a958-61d217ea24c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:45.784128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc938ec-3864-4616-a958-61d217ea24c0 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:45.789657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52722ade-d1ff-4bf8-9154-81b37de5ea5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:45.790270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52722ade-d1ff-4bf8-9154-81b37de5ea5e service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:45.790549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52722ade-d1ff-4bf8-9154-81b37de5ea5e service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:45.790821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52722ade-d1ff-4bf8-9154-81b37de5ea5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:45.801432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52722ade-d1ff-4bf8-9154-81b37de5ea5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:45.803078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52722ade-d1ff-4bf8-9154-81b37de5ea5e service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:45.814216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1178/2331] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:51.057946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a8b2-586b-4091-bcbc-dbf6d0f25f35 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:51.058520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a8b2-586b-4091-bcbc-dbf6d0f25f35 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:51.058520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a8b2-586b-4091-bcbc-dbf6d0f25f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:51.079382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6098a8b2-586b-4091-bcbc-dbf6d0f25f35 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:51.080616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6098a8b2-586b-4091-bcbc-dbf6d0f25f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:51.088558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1154/2332] 10.222.0.62 () {58 vars in 1016 bytes} [Wed Aug 17 16:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:51.122960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52722ade-d1ff-4bf8-9154-81b37de5ea5e service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:51.124498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-52722ade-d1ff-4bf8-9154-81b37de5ea5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:51.139823 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52722ade-d1ff-4bf8-9154-81b37de5ea5e service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:51.145280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf084bb8-3a01-49f5-9141-9a02326e3a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:51.145902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf084bb8-3a01-49f5-9141-9a02326e3a55 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:51.146236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf084bb8-3a01-49f5-9141-9a02326e3a55 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:51.146508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf084bb8-3a01-49f5-9141-9a02326e3a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:51.155657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf084bb8-3a01-49f5-9141-9a02326e3a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:51.157156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf084bb8-3a01-49f5-9141-9a02326e3a55 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:51.166500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1179/2333] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:57.060541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5c7bc-3ec9-4df2-a4a6-27a508e6eee8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:57.061569 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5c7bc-3ec9-4df2-a4a6-27a508e6eee8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:57.062092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5c7bc-3ec9-4df2-a4a6-27a508e6eee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:57.098713 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5df5c7bc-3ec9-4df2-a4a6-27a508e6eee8 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:57.100551 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5df5c7bc-3ec9-4df2-a4a6-27a508e6eee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:57.117296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1155/2334] 10.222.0.62 () {58 vars in 1016 bytes} [Wed Aug 17 16:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:57.144616 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf084bb8-3a01-49f5-9141-9a02326e3a55 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:57.156255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf084bb8-3a01-49f5-9141-9a02326e3a55 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:57.162335 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1f921-28fc-437b-a518-3bdf4403ea85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:57.163192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f921-28fc-437b-a518-3bdf4403ea85 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:57.163731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f921-28fc-437b-a518-3bdf4403ea85 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:57.164201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f921-28fc-437b-a518-3bdf4403ea85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:57.174961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1f921-28fc-437b-a518-3bdf4403ea85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:57.177172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1f921-28fc-437b-a518-3bdf4403ea85 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:57.191324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1180/2335] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:27:02.377280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390e416-e7b2-46d3-89ed-354ca2d1af7b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:02.377880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390e416-e7b2-46d3-89ed-354ca2d1af7b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:02.377880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390e416-e7b2-46d3-89ed-354ca2d1af7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:02.392899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=40 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:02.399192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5390e416-e7b2-46d3-89ed-354ca2d1af7b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:02.400555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5390e416-e7b2-46d3-89ed-354ca2d1af7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:02.410193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1156/2336] 10.222.0.62 () {58 vars in 1016 bytes} [Wed Aug 17 16:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:02.441089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1f921-28fc-437b-a518-3bdf4403ea85 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:02.447349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=82 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:02.454690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1f921-28fc-437b-a518-3bdf4403ea85 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:02.460931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb0006-fa89-4b2c-9606-e1ff4ffa05f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:02.461772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb0006-fa89-4b2c-9606-e1ff4ffa05f2 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:02.462199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb0006-fa89-4b2c-9606-e1ff4ffa05f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:02.462642 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb0006-fa89-4b2c-9606-e1ff4ffa05f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:02.477516 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb0006-fa89-4b2c-9606-e1ff4ffa05f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:02.479208 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb0006-fa89-4b2c-9606-e1ff4ffa05f2 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:02.489757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1181/2337] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:27:03.790603 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae119e5-ee33-40b9-9c9b-6ed99cbf28dc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:03.791102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae119e5-ee33-40b9-9c9b-6ed99cbf28dc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:03.791196 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae119e5-ee33-40b9-9c9b-6ed99cbf28dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:03.811035 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3ae119e5-ee33-40b9-9c9b-6ed99cbf28dc None None] MFA Rules not processed for user `07b2fcfa197e4e93852c9a04aa8f008a`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:03.812266 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3ae119e5-ee33-40b9-9c9b-6ed99cbf28dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:03.871884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1157/2338] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:27:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:05.067303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd75186-bcbf-416b-848c-56e48945097e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:05.067927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd75186-bcbf-416b-848c-56e48945097e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:05.067927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd75186-bcbf-416b-848c-56e48945097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:05.088680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5cd75186-bcbf-416b-848c-56e48945097e None None] MFA Rules not processed for user `b9d6d909e5e24923bbfc53fcf9975425`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:05.090203 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5cd75186-bcbf-416b-848c-56e48945097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:05.145326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1182/2339] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:27:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:06.634260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e37ad-5157-4aad-9657-67a371e1e3e4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:06.634793 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e37ad-5157-4aad-9657-67a371e1e3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:06.634915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e37ad-5157-4aad-9657-67a371e1e3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:06.654918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8d5e37ad-5157-4aad-9657-67a371e1e3e4 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:06.656117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8d5e37ad-5157-4aad-9657-67a371e1e3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:06.664050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1158/2340] 10.222.0.62 () {58 vars in 1016 bytes} [Wed Aug 17 16:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:06.685141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd75186-bcbf-416b-848c-56e48945097e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:06.698143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd75186-bcbf-416b-848c-56e48945097e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:06.703742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5992b63-73db-4530-be82-f7892d9be5d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:06.704345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992b63-73db-4530-be82-f7892d9be5d3 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:06.704624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992b63-73db-4530-be82-f7892d9be5d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:06.704894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992b63-73db-4530-be82-f7892d9be5d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:06.713254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5992b63-73db-4530-be82-f7892d9be5d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:06.715560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5992b63-73db-4530-be82-f7892d9be5d3 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:06.725614 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1183/2341] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:27:16.648752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=30 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:16.720909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=36 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:38.858844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a88c6-b0b5-4534-a388-5a0ef5e60cbf None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:38.863067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a88c6-b0b5-4534-a388-5a0ef5e60cbf None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:38.863067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a88c6-b0b5-4534-a388-5a0ef5e60cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:38.878182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a39a88c6-b0b5-4534-a388-5a0ef5e60cbf None None] MFA Rules not processed for user `7b92f9048d654e4787d036f6adbd840b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:38.879395 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a39a88c6-b0b5-4534-a388-5a0ef5e60cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:38.935004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1159/2342] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:27:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:48.703450 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5992b63-73db-4530-be82-f7892d9be5d3 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:48.704429 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b5992b63-73db-4530-be82-f7892d9be5d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:48.717484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5992b63-73db-4530-be82-f7892d9be5d3 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:48.722103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437f195-9309-4c9a-a31d-6ac73da4a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:48.722719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437f195-9309-4c9a-a31d-6ac73da4a346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:48.722993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437f195-9309-4c9a-a31d-6ac73da4a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:48.723256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437f195-9309-4c9a-a31d-6ac73da4a346 admin admin] PATH_INFO: `/v3/users/64c63d6be76f4441b6c40a4eb58c947c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:48.724347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437f195-9309-4c9a-a31d-6ac73da4a346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c63d6be76f4441b6c40a4eb58c947c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:48.726291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437f195-9309-4c9a-a31d-6ac73da4a346 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:48.922087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0437f195-9309-4c9a-a31d-6ac73da4a346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c63d6be76f4441b6c40a4eb58c947c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:48.922814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0437f195-9309-4c9a-a31d-6ac73da4a346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c63d6be76f4441b6c40a4eb58c947c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:48.927976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=25 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:48.939457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0437f195-9309-4c9a-a31d-6ac73da4a346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c63d6be76f4441b6c40a4eb58c947c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:48.948545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0437f195-9309-4c9a-a31d-6ac73da4a346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c63d6be76f4441b6c40a4eb58c947c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:48.949484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0437f195-9309-4c9a-a31d-6ac73da4a346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c63d6be76f4441b6c40a4eb58c947c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:49.019746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1184/2343] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:27:48 2022] DELETE /identity/v3/users/64c63d6be76f4441b6c40a4eb58c947c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:27:49.302194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a88c6-b0b5-4534-a388-5a0ef5e60cbf None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.318419 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a88c6-b0b5-4534-a388-5a0ef5e60cbf None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.382678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.383420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.383696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.383969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] PATH_INFO: `/v3/projects/d1168c28035f45daa521dec7844e37bd` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.385239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1168c28035f45daa521dec7844e37bd)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:49.387613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:49.502365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1168c28035f45daa521dec7844e37bd', 'request_id': 'req-7beaf7a0-5e11-46ac-b099-d269767a37c6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:49.511535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1168c28035f45daa521dec7844e37bd', 'request_id': 'req-7beaf7a0-5e11-46ac-b099-d269767a37c6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:49.586031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1168c28035f45daa521dec7844e37bd', 'request_id': 'req-7beaf7a0-5e11-46ac-b099-d269767a37c6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:49.600032 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] The token cache is being invalidate because project d1168c28035f45daa521dec7844e37bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:27:49.600328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:49.601003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7beaf7a0-5e11-46ac-b099-d269767a37c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:49.602549 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1160/2344] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:27:49 2022] DELETE /identity/v3/projects/d1168c28035f45daa521dec7844e37bd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:27:49.608004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd10af-76a2-43f4-bcc6-338d5dfff861 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.608351 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd10af-76a2-43f4-bcc6-338d5dfff861 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.608633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd10af-76a2-43f4-bcc6-338d5dfff861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.629946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-88cd10af-76a2-43f4-bcc6-338d5dfff861 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:49.631168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-88cd10af-76a2-43f4-bcc6-338d5dfff861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:49.705057 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1185/2345] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:27:49.713076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06078c-a6aa-4f09-9624-4395afe7c397 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.713477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06078c-a6aa-4f09-9624-4395afe7c397 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.713754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06078c-a6aa-4f09-9624-4395afe7c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.736639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ab06078c-a6aa-4f09-9624-4395afe7c397 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:49.738145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ab06078c-a6aa-4f09-9624-4395afe7c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:49.747709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1161/2346] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:49.753219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd10af-76a2-43f4-bcc6-338d5dfff861 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.764847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd10af-76a2-43f4-bcc6-338d5dfff861 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.769642 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bb942-355d-4afa-a404-7965f9d864b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.770640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bb942-355d-4afa-a404-7965f9d864b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.772179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bb942-355d-4afa-a404-7965f9d864b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.772179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bb942-355d-4afa-a404-7965f9d864b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.772413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bb942-355d-4afa-a404-7965f9d864b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:27:49.772780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bb942-355d-4afa-a404-7965f9d864b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:49.775610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bb942-355d-4afa-a404-7965f9d864b4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:49.789216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1186/2347] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:27:49.793891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06078c-a6aa-4f09-9624-4395afe7c397 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.805386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06078c-a6aa-4f09-9624-4395afe7c397 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.810421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feef925-805e-4de7-b1c0-dffd986af1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.811023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef925-805e-4de7-b1c0-dffd986af1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.811295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef925-805e-4de7-b1c0-dffd986af1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.811558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef925-805e-4de7-b1c0-dffd986af1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.812176 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef925-805e-4de7-b1c0-dffd986af1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:49.814194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef925-805e-4de7-b1c0-dffd986af1c5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:49.925038 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1162/2348] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:27:49 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:27:49.929267 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bb942-355d-4afa-a404-7965f9d864b4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.940082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bb942-355d-4afa-a404-7965f9d864b4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.996261 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445f745-3954-4ef6-a4c8-89c3005e29f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.996988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f745-3954-4ef6-a4c8-89c3005e29f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.997296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f745-3954-4ef6-a4c8-89c3005e29f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.997559 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445f745-3954-4ef6-a4c8-89c3005e29f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.998190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445f745-3954-4ef6-a4c8-89c3005e29f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:50.000141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445f745-3954-4ef6-a4c8-89c3005e29f2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:50.008823 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:50.105141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1187/2349] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:27:49 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:27:50.106691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feef925-805e-4de7-b1c0-dffd986af1c5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:50.117296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feef925-805e-4de7-b1c0-dffd986af1c5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:50.122624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0ea47-0d14-46f0-978a-5d5fa29a3f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:50.123225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0ea47-0d14-46f0-978a-5d5fa29a3f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:50.127260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0ea47-0d14-46f0-978a-5d5fa29a3f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:50.127260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0ea47-0d14-46f0-978a-5d5fa29a3f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:50.127260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0ea47-0d14-46f0-978a-5d5fa29a3f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:50.127260 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0ea47-0d14-46f0-978a-5d5fa29a3f1d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:50.137406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1163/2350] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:27:50.141394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445f745-3954-4ef6-a4c8-89c3005e29f2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:50.153186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445f745-3954-4ef6-a4c8-89c3005e29f2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:50.158342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee8c73-93bc-4506-af3c-62aed534c8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:50.158965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8c73-93bc-4506-af3c-62aed534c8de admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:50.159242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8c73-93bc-4506-af3c-62aed534c8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:50.159514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8c73-93bc-4506-af3c-62aed534c8de admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:50.160165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee8c73-93bc-4506-af3c-62aed534c8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:50.161895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee8c73-93bc-4506-af3c-62aed534c8de admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:50.173941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1188/2351] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:27:50.179198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0ea47-0d14-46f0-978a-5d5fa29a3f1d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:50.188481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0ea47-0d14-46f0-978a-5d5fa29a3f1d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:50.193333 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09290dc1-a64c-4935-a8d6-1d0f7c292d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:50.194023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09290dc1-a64c-4935-a8d6-1d0f7c292d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:50.194293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09290dc1-a64c-4935-a8d6-1d0f7c292d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:50.194948 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09290dc1-a64c-4935-a8d6-1d0f7c292d58 admin admin] PATH_INFO: `/v3/projects/aa5d5b9a56e44afaa4740d9c6055ca01/users/abf35fc0be0e476291410f8657a44841/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:50.212088 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09290dc1-a64c-4935-a8d6-1d0f7c292d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5d5b9a56e44afaa4740d9c6055ca01, user_id=abf35fc0be0e476291410f8657a44841, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:50.215491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09290dc1-a64c-4935-a8d6-1d0f7c292d58 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:50.318615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1164/2352] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:27:50 2022] PUT /identity/v3/projects/aa5d5b9a56e44afaa4740d9c6055ca01/users/abf35fc0be0e476291410f8657a44841/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:27:50.324160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24281ab8-4476-48b6-a6b9-314a193109bc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:50.324442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24281ab8-4476-48b6-a6b9-314a193109bc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:50.324712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24281ab8-4476-48b6-a6b9-314a193109bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:50.343838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-24281ab8-4476-48b6-a6b9-314a193109bc None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:50.345029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-24281ab8-4476-48b6-a6b9-314a193109bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:50.403986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1189/2353] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:50.413675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09290dc1-a64c-4935-a8d6-1d0f7c292d58 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:50.415358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-09290dc1-a64c-4935-a8d6-1d0f7c292d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:50.445860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:50.472951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09290dc1-a64c-4935-a8d6-1d0f7c292d58 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:50.476640 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0077-1427-4294-9c4a-c54a02943065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:50.477242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0077-1427-4294-9c4a-c54a02943065 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:50.477574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0077-1427-4294-9c4a-c54a02943065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:50.477847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0077-1427-4294-9c4a-c54a02943065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:50.486770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef0077-1427-4294-9c4a-c54a02943065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:50.488261 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef0077-1427-4294-9c4a-c54a02943065 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:50.498083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1165/2354] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:27:56.267246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7881-b8e3-445a-b376-c7fc1f83291d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:56.267812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7881-b8e3-445a-b376-c7fc1f83291d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:56.267812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e7881-b8e3-445a-b376-c7fc1f83291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:56.298132 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4f3e7881-b8e3-445a-b376-c7fc1f83291d None None] MFA Rules not processed for user `abf35fc0be0e476291410f8657a44841`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:56.299360 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4f3e7881-b8e3-445a-b376-c7fc1f83291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:56.374361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1190/2355] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:27:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:56.378891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0077-1427-4294-9c4a-c54a02943065 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:56.389884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0077-1427-4294-9c4a-c54a02943065 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:56.394779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ad676-9e97-4cf9-90a5-05a943c5f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:56.395399 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ad676-9e97-4cf9-90a5-05a943c5f27d admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:56.395879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ad676-9e97-4cf9-90a5-05a943c5f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:56.396150 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ad676-9e97-4cf9-90a5-05a943c5f27d admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:56.396782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ad676-9e97-4cf9-90a5-05a943c5f27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:56.398705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ad676-9e97-4cf9-90a5-05a943c5f27d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:56.503268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1166/2356] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:27:56 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:27:56.508757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e7881-b8e3-445a-b376-c7fc1f83291d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:56.519548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e7881-b8e3-445a-b376-c7fc1f83291d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:56.575256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0c473-2252-42d2-9844-753be09df7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:56.575753 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0c473-2252-42d2-9844-753be09df7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:56.576026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0c473-2252-42d2-9844-753be09df7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:56.576288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0c473-2252-42d2-9844-753be09df7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:56.576898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0c473-2252-42d2-9844-753be09df7f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:56.578831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0c473-2252-42d2-9844-753be09df7f4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:56.649743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:56.656656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1191/2357] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:27:56 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:27:56.660841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ad676-9e97-4cf9-90a5-05a943c5f27d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:56.672570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ad676-9e97-4cf9-90a5-05a943c5f27d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:56.677325 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12e8df-45b6-4474-9f54-0957d6a12860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:56.678066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12e8df-45b6-4474-9f54-0957d6a12860 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:56.678343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12e8df-45b6-4474-9f54-0957d6a12860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:56.678611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12e8df-45b6-4474-9f54-0957d6a12860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:56.679270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12e8df-45b6-4474-9f54-0957d6a12860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:56.681071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12e8df-45b6-4474-9f54-0957d6a12860 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:56.692755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1167/2358] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:27:56.697036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0c473-2252-42d2-9844-753be09df7f4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:56.707149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0c473-2252-42d2-9844-753be09df7f4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:56.711898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de758a6-d5f9-48ef-8d5f-40db9b572747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:56.712863 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de758a6-d5f9-48ef-8d5f-40db9b572747 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:56.713190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de758a6-d5f9-48ef-8d5f-40db9b572747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:56.714460 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de758a6-d5f9-48ef-8d5f-40db9b572747 admin admin] PATH_INFO: `/v3/projects/c034c88971ad4c349d9f3d828962cec1/users/f332c0b1fae14375ab56829703361317/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:56.729696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de758a6-d5f9-48ef-8d5f-40db9b572747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c034c88971ad4c349d9f3d828962cec1, user_id=f332c0b1fae14375ab56829703361317, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:56.732537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de758a6-d5f9-48ef-8d5f-40db9b572747 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:56.787656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1192/2359] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:27:56 2022] PUT /identity/v3/projects/c034c88971ad4c349d9f3d828962cec1/users/f332c0b1fae14375ab56829703361317/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:27:56.792320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12e8df-45b6-4474-9f54-0957d6a12860 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:56.802509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12e8df-45b6-4474-9f54-0957d6a12860 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:56.864619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60606ea-bd5e-4259-8a9a-fae4189fc3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:56.865273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60606ea-bd5e-4259-8a9a-fae4189fc3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:56.865584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60606ea-bd5e-4259-8a9a-fae4189fc3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:56.865843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60606ea-bd5e-4259-8a9a-fae4189fc3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:56.866506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60606ea-bd5e-4259-8a9a-fae4189fc3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:56.868254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60606ea-bd5e-4259-8a9a-fae4189fc3b8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:56.879871 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1168/2360] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:27:56.883775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de758a6-d5f9-48ef-8d5f-40db9b572747 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:56.900254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de758a6-d5f9-48ef-8d5f-40db9b572747 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:56.907427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c1d0a-97d9-44ec-9147-741b40354e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:56.908744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c1d0a-97d9-44ec-9147-741b40354e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:56.909016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c1d0a-97d9-44ec-9147-741b40354e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:56.909292 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c1d0a-97d9-44ec-9147-741b40354e45 admin admin] PATH_INFO: `/v3/projects/c034c88971ad4c349d9f3d828962cec1/users/f332c0b1fae14375ab56829703361317/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:56.912212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c1d0a-97d9-44ec-9147-741b40354e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c034c88971ad4c349d9f3d828962cec1, user_id=f332c0b1fae14375ab56829703361317, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:56.915001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c1d0a-97d9-44ec-9147-741b40354e45 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:56.928707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1193/2361] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:27:56 2022] PUT /identity/v3/projects/c034c88971ad4c349d9f3d828962cec1/users/f332c0b1fae14375ab56829703361317/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:02.577919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f8262-69d3-400a-8593-5223aa64b01b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.578498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f8262-69d3-400a-8593-5223aa64b01b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.578498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f8262-69d3-400a-8593-5223aa64b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.611902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-bf5f8262-69d3-400a-8593-5223aa64b01b None None] MFA Rules not processed for user `f332c0b1fae14375ab56829703361317`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:02.613178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bf5f8262-69d3-400a-8593-5223aa64b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:02.697214 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1169/2362] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:02.711777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c1d0a-97d9-44ec-9147-741b40354e45 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:02.714247 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f44c1d0a-97d9-44ec-9147-741b40354e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:02.925158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c1d0a-97d9-44ec-9147-741b40354e45 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:02.930745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6322e-0387-4182-a21d-04fec8afdb1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:02.932403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6322e-0387-4182-a21d-04fec8afdb1b service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.932403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6322e-0387-4182-a21d-04fec8afdb1b service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.932403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6322e-0387-4182-a21d-04fec8afdb1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.991365 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6322e-0387-4182-a21d-04fec8afdb1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:02.992632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6322e-0387-4182-a21d-04fec8afdb1b service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:03.002824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1194/2363] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:05.587238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca0876-e831-4322-9ffd-19295744aedd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.587943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca0876-e831-4322-9ffd-19295744aedd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.588753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca0876-e831-4322-9ffd-19295744aedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.609327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-08ca0876-e831-4322-9ffd-19295744aedd None None] MFA Rules not processed for user `abf35fc0be0e476291410f8657a44841`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:05.610686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-08ca0876-e831-4322-9ffd-19295744aedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:05.621663 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1170/2364] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:12.998579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:15.603708 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:15.787207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9a32-aabb-4a4a-8439-eef54d6728cd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.787687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9a32-aabb-4a4a-8439-eef54d6728cd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.787804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9a32-aabb-4a4a-8439-eef54d6728cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.808639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5b2b9a32-aabb-4a4a-8439-eef54d6728cd None None] MFA Rules not processed for user `58d8aba7074e4a07b0e93107ea0b75cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:15.810183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5b2b9a32-aabb-4a4a-8439-eef54d6728cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:15.869956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1195/2365] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:28:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:25.862821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=25 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:28.458706 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b251d-d42a-4d21-ba7c-9b91720f07f3 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:28.459228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b251d-d42a-4d21-ba7c-9b91720f07f3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:28.459228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b251d-d42a-4d21-ba7c-9b91720f07f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:28.479502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ef0b251d-d42a-4d21-ba7c-9b91720f07f3 None None] MFA Rules not processed for user `b9d6d909e5e24923bbfc53fcf9975425`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:28.480708 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ef0b251d-d42a-4d21-ba7c-9b91720f07f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:28.538285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1171/2366] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:32.781263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9a32-aabb-4a4a-8439-eef54d6728cd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:32.843908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9a32-aabb-4a4a-8439-eef54d6728cd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:32.847462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3dad7-af7c-4b88-98e0-049c40b25e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:32.848235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3dad7-af7c-4b88-98e0-049c40b25e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:32.848515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3dad7-af7c-4b88-98e0-049c40b25e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:32.848810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3dad7-af7c-4b88-98e0-049c40b25e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:32.850586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-77f3dad7-af7c-4b88-98e0-049c40b25e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:32.866226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b251d-d42a-4d21-ba7c-9b91720f07f3 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:32.866771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3dad7-af7c-4b88-98e0-049c40b25e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:32.868797 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3dad7-af7c-4b88-98e0-049c40b25e6b service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:32.868901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ef0b251d-d42a-4d21-ba7c-9b91720f07f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:32.880114 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1196/2367] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:32.883089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b251d-d42a-4d21-ba7c-9b91720f07f3 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:32.887343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ed64-4b76-452e-9b2e-4f30780b7aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:32.887955 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ed64-4b76-452e-9b2e-4f30780b7aff service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:32.888231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ed64-4b76-452e-9b2e-4f30780b7aff service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:32.888500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ed64-4b76-452e-9b2e-4f30780b7aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:32.890363 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4f84ed64-4b76-452e-9b2e-4f30780b7aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:32.907559 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ed64-4b76-452e-9b2e-4f30780b7aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:32.909097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ed64-4b76-452e-9b2e-4f30780b7aff service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:32.927488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1172/2368] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:28:37.234888 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7ec8-7428-4337-8491-47afb0963053 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:37.235398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7ec8-7428-4337-8491-47afb0963053 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:37.235517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7ec8-7428-4337-8491-47afb0963053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:37.254676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3bbe7ec8-7428-4337-8491-47afb0963053 None None] MFA Rules not processed for user `07b2fcfa197e4e93852c9a04aa8f008a`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:37.255935 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3bbe7ec8-7428-4337-8491-47afb0963053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:37.312302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1197/2369] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:39.658805 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ed64-4b76-452e-9b2e-4f30780b7aff service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:39.668923 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ed64-4b76-452e-9b2e-4f30780b7aff service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:39.673916 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fc396-4442-4d1a-9c6e-610ddb3f6b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:39.675908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fc396-4442-4d1a-9c6e-610ddb3f6b0b service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:39.676208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fc396-4442-4d1a-9c6e-610ddb3f6b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:39.676593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fc396-4442-4d1a-9c6e-610ddb3f6b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:39.687688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fc396-4442-4d1a-9c6e-610ddb3f6b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:39.689126 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fc396-4442-4d1a-9c6e-610ddb3f6b0b service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:39.699405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1173/2370] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:46.163445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe7ec8-7428-4337-8491-47afb0963053 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:46.177345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe7ec8-7428-4337-8491-47afb0963053 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:46.184350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e9b65-84ba-4666-af92-8d374dddb0e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:46.184963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e9b65-84ba-4666-af92-8d374dddb0e6 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:46.185240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e9b65-84ba-4666-af92-8d374dddb0e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:46.185544 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e9b65-84ba-4666-af92-8d374dddb0e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:46.187403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a69e9b65-84ba-4666-af92-8d374dddb0e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:46.198229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e9b65-84ba-4666-af92-8d374dddb0e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:46.199807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e9b65-84ba-4666-af92-8d374dddb0e6 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:46.208758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1198/2371] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:47.766707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fc396-4442-4d1a-9c6e-610ddb3f6b0b service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:47.768039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e72fc396-4442-4d1a-9c6e-610ddb3f6b0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:47.783932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fc396-4442-4d1a-9c6e-610ddb3f6b0b service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:47.789409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd25e5-5f91-485a-a9ab-f7b56b92167b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:47.790007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd25e5-5f91-485a-a9ab-f7b56b92167b service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:47.790286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd25e5-5f91-485a-a9ab-f7b56b92167b service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:47.790557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd25e5-5f91-485a-a9ab-f7b56b92167b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:47.792831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f0dd25e5-5f91-485a-a9ab-f7b56b92167b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:47.852049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd25e5-5f91-485a-a9ab-f7b56b92167b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:47.853702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd25e5-5f91-485a-a9ab-f7b56b92167b service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:47.862705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1174/2372] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:56.205025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=57 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:57.858521 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=65 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:29:02.213240 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba9a50-1dd4-484f-9a4c-ddf177e9c3f6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:02.213868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba9a50-1dd4-484f-9a4c-ddf177e9c3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:02.213868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba9a50-1dd4-484f-9a4c-ddf177e9c3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:02.233945 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ceba9a50-1dd4-484f-9a4c-ddf177e9c3f6 None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:29:02.235194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ceba9a50-1dd4-484f-9a4c-ddf177e9c3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:02.290922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1199/2373] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:29:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:29:02.409858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd25e5-5f91-485a-a9ab-f7b56b92167b service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:29:02.411296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f0dd25e5-5f91-485a-a9ab-f7b56b92167b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:02.480101 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd25e5-5f91-485a-a9ab-f7b56b92167b service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:29:02.485004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef54db1-0ef2-4e4b-a04f-6295c3103374 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:29:02.485636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54db1-0ef2-4e4b-a04f-6295c3103374 service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:02.485915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54db1-0ef2-4e4b-a04f-6295c3103374 service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:02.486191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54db1-0ef2-4e4b-a04f-6295c3103374 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:02.494041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef54db1-0ef2-4e4b-a04f-6295c3103374 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:29:02.495624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef54db1-0ef2-4e4b-a04f-6295c3103374 service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:29:02.503482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1175/2374] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:29:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:29:12.283686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=25 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:29:12.500338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=32 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:29:13.496407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba9a50-1dd4-484f-9a4c-ddf177e9c3f6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:29:13.505636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba9a50-1dd4-484f-9a4c-ddf177e9c3f6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:29:13.509243 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513bde4-6fd9-47ca-a14d-a427beb2b98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:29:13.509876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513bde4-6fd9-47ca-a14d-a427beb2b98a service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:13.510152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513bde4-6fd9-47ca-a14d-a427beb2b98a service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:13.510421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513bde4-6fd9-47ca-a14d-a427beb2b98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:13.512130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0513bde4-6fd9-47ca-a14d-a427beb2b98a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:13.521595 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513bde4-6fd9-47ca-a14d-a427beb2b98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:29:13.523024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513bde4-6fd9-47ca-a14d-a427beb2b98a service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:29:13.531482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1200/2375] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:29:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:29:19.143338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef54db1-0ef2-4e4b-a04f-6295c3103374 service swift] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:29:19.144750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3ef54db1-0ef2-4e4b-a04f-6295c3103374 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:19.213944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef54db1-0ef2-4e4b-a04f-6295c3103374 service swift] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:29:19.218918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f8c4c-2aae-4e2a-8572-c92a6756aba9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da5e1da2196b4ff399921809f40d3002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:29:19.219524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f8c4c-2aae-4e2a-8572-c92a6756aba9 service placement] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:19.219794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f8c4c-2aae-4e2a-8572-c92a6756aba9 service placement] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:19.220060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f8c4c-2aae-4e2a-8572-c92a6756aba9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:19.221754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6b7f8c4c-2aae-4e2a-8572-c92a6756aba9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:19.232808 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f8c4c-2aae-4e2a-8572-c92a6756aba9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:29:19.234440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f8c4c-2aae-4e2a-8572-c92a6756aba9 service placement] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:29:19.244177 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1176/2376] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:29:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:29:21.287960 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513bde4-6fd9-47ca-a14d-a427beb2b98a service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:29:21.301408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513bde4-6fd9-47ca-a14d-a427beb2b98a service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:29:21.307432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7087ec-f3b2-4702-829d-b04f543113d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:29:21.308025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7087ec-f3b2-4702-829d-b04f543113d9 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:21.308297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7087ec-f3b2-4702-829d-b04f543113d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:21.308563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7087ec-f3b2-4702-829d-b04f543113d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:21.310388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ef7087ec-f3b2-4702-829d-b04f543113d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:21.322026 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7087ec-f3b2-4702-829d-b04f543113d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:29:21.323591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7087ec-f3b2-4702-829d-b04f543113d9 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:29:21.332502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1201/2377] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:29:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:29:21.585858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f20b9-db20-4189-b49c-4bb882f12256 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:21.586387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f20b9-db20-4189-b49c-4bb882f12256 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:21.586556 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f20b9-db20-4189-b49c-4bb882f12256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:21.607570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e16f20b9-db20-4189-b49c-4bb882f12256 None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:29:21.608748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e16f20b9-db20-4189-b49c-4bb882f12256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:21.616178 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1177/2378] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:29:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:29:21.628784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7087ec-f3b2-4702-829d-b04f543113d9 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:29:21.639969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7087ec-f3b2-4702-829d-b04f543113d9 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:29:21.644953 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd6820-6a67-4693-a542-f8784fc6a004 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:29:21.645836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd6820-6a67-4693-a542-f8784fc6a004 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:21.646112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd6820-6a67-4693-a542-f8784fc6a004 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:21.646381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd6820-6a67-4693-a542-f8784fc6a004 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:21.654507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd6820-6a67-4693-a542-f8784fc6a004 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:29:21.656220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd6820-6a67-4693-a542-f8784fc6a004 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:29:21.664255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1202/2379] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:29:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:29:31.600413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=35 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:29:31.660991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=18 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:29:35.644033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f20b9-db20-4189-b49c-4bb882f12256 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:29:35.657349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f20b9-db20-4189-b49c-4bb882f12256 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:29:35.662870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2503fb-1544-4f5e-924f-fd9f8a826db0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:29:35.663470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2503fb-1544-4f5e-924f-fd9f8a826db0 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:35.663738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2503fb-1544-4f5e-924f-fd9f8a826db0 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:35.663996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2503fb-1544-4f5e-924f-fd9f8a826db0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:35.665731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4d2503fb-1544-4f5e-924f-fd9f8a826db0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:35.678229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2503fb-1544-4f5e-924f-fd9f8a826db0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:29:35.679810 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2503fb-1544-4f5e-924f-fd9f8a826db0 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:29:35.690917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1178/2380] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:29:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:29:40.663907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd6820-6a67-4693-a542-f8784fc6a004 service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:29:40.687784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd6820-6a67-4693-a542-f8784fc6a004 service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:29:40.694277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bf310-e1b7-438e-a30b-45d5bcdf8f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:29:40.695214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf310-e1b7-438e-a30b-45d5bcdf8f13 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:40.695690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf310-e1b7-438e-a30b-45d5bcdf8f13 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:40.696139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf310-e1b7-438e-a30b-45d5bcdf8f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:40.698552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fe3bf310-e1b7-438e-a30b-45d5bcdf8f13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:40.713554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bf310-e1b7-438e-a30b-45d5bcdf8f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:29:40.716371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bf310-e1b7-438e-a30b-45d5bcdf8f13 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:29:40.737331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1203/2381] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:29:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:29:41.027739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619696-9524-450a-8fd5-866928fc44f8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:41.028182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619696-9524-450a-8fd5-866928fc44f8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:41.028360 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98619696-9524-450a-8fd5-866928fc44f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:41.051158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-98619696-9524-450a-8fd5-866928fc44f8 None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:29:41.052712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-98619696-9524-450a-8fd5-866928fc44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:41.062060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1179/2382] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 17 16:29:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:29:41.078986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bf310-e1b7-438e-a30b-45d5bcdf8f13 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:29:41.094659 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bf310-e1b7-438e-a30b-45d5bcdf8f13 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:29:41.101047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89f136-4373-4fcc-8f47-7660cc9b0635 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:29:41.103710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89f136-4373-4fcc-8f47-7660cc9b0635 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:41.104767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89f136-4373-4fcc-8f47-7660cc9b0635 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:41.105543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89f136-4373-4fcc-8f47-7660cc9b0635 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:41.117138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89f136-4373-4fcc-8f47-7660cc9b0635 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:29:41.118864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89f136-4373-4fcc-8f47-7660cc9b0635 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:29:41.129418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1204/2383] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:29:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:29:51.045311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=9 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:29:51.125446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=12 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:29:59.897976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619696-9524-450a-8fd5-866928fc44f8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:29:59.914250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98619696-9524-450a-8fd5-866928fc44f8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:29:59.914250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3489c-4423-47d6-a3ea-cc3b3425daa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:29:59.914250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3489c-4423-47d6-a3ea-cc3b3425daa7 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:59.914250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3489c-4423-47d6-a3ea-cc3b3425daa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:59.914715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3489c-4423-47d6-a3ea-cc3b3425daa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:59.915066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a3c3489c-4423-47d6-a3ea-cc3b3425daa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:59.980518 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3489c-4423-47d6-a3ea-cc3b3425daa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:29:59.982035 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3489c-4423-47d6-a3ea-cc3b3425daa7 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:29:59.995298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1180/2384] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:00.752814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89f136-4373-4fcc-8f47-7660cc9b0635 service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:00.763130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89f136-4373-4fcc-8f47-7660cc9b0635 service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:00.766940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf3005-5cf7-471c-83d5-7f772163afda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:00.767534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3005-5cf7-471c-83d5-7f772163afda service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:00.767807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3005-5cf7-471c-83d5-7f772163afda service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:00.768073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3005-5cf7-471c-83d5-7f772163afda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:00.770255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d8cf3005-5cf7-471c-83d5-7f772163afda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:00.782086 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf3005-5cf7-471c-83d5-7f772163afda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:00.783510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf3005-5cf7-471c-83d5-7f772163afda service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:00.792650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1205/2385] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:04.026773 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3489c-4423-47d6-a3ea-cc3b3425daa7 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:04.038943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3489c-4423-47d6-a3ea-cc3b3425daa7 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:04.050200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafc57a-74d9-4396-b450-40ed3cb027c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:04.051175 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafc57a-74d9-4396-b450-40ed3cb027c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:04.052037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafc57a-74d9-4396-b450-40ed3cb027c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:04.053016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafc57a-74d9-4396-b450-40ed3cb027c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:04.056003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9dafc57a-74d9-4396-b450-40ed3cb027c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:04.083061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafc57a-74d9-4396-b450-40ed3cb027c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:04.093853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafc57a-74d9-4396-b450-40ed3cb027c6 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:04.125954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1181/2386] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:04.612107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf3005-5cf7-471c-83d5-7f772163afda service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:04.626354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf3005-5cf7-471c-83d5-7f772163afda service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:04.638183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9b2c-0dbf-4c25-be30-8b7e76435f10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da5e1da2196b4ff399921809f40d3002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:04.639274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9b2c-0dbf-4c25-be30-8b7e76435f10 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:04.639764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9b2c-0dbf-4c25-be30-8b7e76435f10 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:04.640247 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9b2c-0dbf-4c25-be30-8b7e76435f10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:04.642353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c2bb9b2c-0dbf-4c25-be30-8b7e76435f10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:04.656744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb9b2c-0dbf-4c25-be30-8b7e76435f10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:04.658940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb9b2c-0dbf-4c25-be30-8b7e76435f10 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:04.671983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1206/2387] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:04.746536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafc57a-74d9-4396-b450-40ed3cb027c6 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:04.747976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9dafc57a-74d9-4396-b450-40ed3cb027c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:04.766044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafc57a-74d9-4396-b450-40ed3cb027c6 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:04.770658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c8d1c-b8a2-4415-bbc7-890f53247fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:04.771288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8d1c-b8a2-4415-bbc7-890f53247fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:04.771561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8d1c-b8a2-4415-bbc7-890f53247fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:04.771858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8d1c-b8a2-4415-bbc7-890f53247fbe admin admin] PATH_INFO: `/v3/users/b9d6d909e5e24923bbfc53fcf9975425` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:04.772978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c8d1c-b8a2-4415-bbc7-890f53247fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d6d909e5e24923bbfc53fcf9975425)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:04.775003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c8d1c-b8a2-4415-bbc7-890f53247fbe admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:04.954270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2a3c8d1c-b8a2-4415-bbc7-890f53247fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d6d909e5e24923bbfc53fcf9975425'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:04.955058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2a3c8d1c-b8a2-4415-bbc7-890f53247fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d6d909e5e24923bbfc53fcf9975425'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:04.964643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2a3c8d1c-b8a2-4415-bbc7-890f53247fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d6d909e5e24923bbfc53fcf9975425'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:04.977773 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2a3c8d1c-b8a2-4415-bbc7-890f53247fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d6d909e5e24923bbfc53fcf9975425'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:05.081834 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2a3c8d1c-b8a2-4415-bbc7-890f53247fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d6d909e5e24923bbfc53fcf9975425'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:05.089024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1182/2388] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:04 2022] DELETE /identity/v3/users/b9d6d909e5e24923bbfc53fcf9975425 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:05.534782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9b2c-0dbf-4c25-be30-8b7e76435f10 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:05.554457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9b2c-0dbf-4c25-be30-8b7e76435f10 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:05.632428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:05.633154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:05.633354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:05.633679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] PATH_INFO: `/v3/projects/ffbee49086ca4361a23040ce60c10c68` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:05.634783 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffbee49086ca4361a23040ce60c10c68)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:05.636695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:05.791713 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffbee49086ca4361a23040ce60c10c68', 'request_id': 'req-40590f13-d24f-4f83-91a9-07dc84a1984d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:05.804181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffbee49086ca4361a23040ce60c10c68', 'request_id': 'req-40590f13-d24f-4f83-91a9-07dc84a1984d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:05.814249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffbee49086ca4361a23040ce60c10c68', 'request_id': 'req-40590f13-d24f-4f83-91a9-07dc84a1984d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:05.892280 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] The token cache is being invalidate because project ffbee49086ca4361a23040ce60c10c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:05.892835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:05.895199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-40590f13-d24f-4f83-91a9-07dc84a1984d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:05.896690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1207/2389] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:05 2022] DELETE /identity/v3/projects/ffbee49086ca4361a23040ce60c10c68 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:05.901941 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15332e1f-a0f5-4ee8-9185-3edd5aa8f3ed None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:05.903089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15332e1f-a0f5-4ee8-9185-3edd5aa8f3ed None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:05.903526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15332e1f-a0f5-4ee8-9185-3edd5aa8f3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:05.931300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-15332e1f-a0f5-4ee8-9185-3edd5aa8f3ed None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:05.932588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-15332e1f-a0f5-4ee8-9185-3edd5aa8f3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:06.006732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:06.021487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1183/2390] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:06.030318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49552a-26a2-45df-8ddc-ab19918ee1fa None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:06.030610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49552a-26a2-45df-8ddc-ab19918ee1fa None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:06.030856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49552a-26a2-45df-8ddc-ab19918ee1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:06.054969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3c49552a-26a2-45df-8ddc-ab19918ee1fa None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:06.056543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3c49552a-26a2-45df-8ddc-ab19918ee1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:06.069864 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1208/2391] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:06.075770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15332e1f-a0f5-4ee8-9185-3edd5aa8f3ed None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:06.088007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15332e1f-a0f5-4ee8-9185-3edd5aa8f3ed None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:06.094166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cfc5c-4bb7-4c85-bea4-cee6ea291075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:06.096097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cfc5c-4bb7-4c85-bea4-cee6ea291075 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:06.096612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cfc5c-4bb7-4c85-bea4-cee6ea291075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:06.096965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cfc5c-4bb7-4c85-bea4-cee6ea291075 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:06.097733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cfc5c-4bb7-4c85-bea4-cee6ea291075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:06.098098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cfc5c-4bb7-4c85-bea4-cee6ea291075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:06.100090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cfc5c-4bb7-4c85-bea4-cee6ea291075 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:06.119794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49552a-26a2-45df-8ddc-ab19918ee1fa None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:06.120268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1184/2392] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:06.131215 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49552a-26a2-45df-8ddc-ab19918ee1fa None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:06.137757 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7701062-1210-4363-9f28-7b188515765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:06.138738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7701062-1210-4363-9f28-7b188515765c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:06.139898 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7701062-1210-4363-9f28-7b188515765c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:06.140258 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7701062-1210-4363-9f28-7b188515765c admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:06.140944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7701062-1210-4363-9f28-7b188515765c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:06.143472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7701062-1210-4363-9f28-7b188515765c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:06.231736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1209/2393] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:06 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:06.233669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cfc5c-4bb7-4c85-bea4-cee6ea291075 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:06.244878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cfc5c-4bb7-4c85-bea4-cee6ea291075 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:06.307530 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a698ba-d23c-42cd-be2c-e37d0c43d12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:06.308184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a698ba-d23c-42cd-be2c-e37d0c43d12e admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:06.308464 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a698ba-d23c-42cd-be2c-e37d0c43d12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:06.308731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a698ba-d23c-42cd-be2c-e37d0c43d12e admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:06.309380 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a698ba-d23c-42cd-be2c-e37d0c43d12e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:06.314424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a698ba-d23c-42cd-be2c-e37d0c43d12e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:06.425881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1185/2394] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:06 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:06.429901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7701062-1210-4363-9f28-7b188515765c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:06.440763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7701062-1210-4363-9f28-7b188515765c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:06.445823 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791af57c-5976-47e9-996b-08074084278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:06.446487 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791af57c-5976-47e9-996b-08074084278a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:06.446760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791af57c-5976-47e9-996b-08074084278a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:06.447022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791af57c-5976-47e9-996b-08074084278a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:06.447660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791af57c-5976-47e9-996b-08074084278a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:06.449262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791af57c-5976-47e9-996b-08074084278a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:06.461161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1210/2395] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:06.469956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a698ba-d23c-42cd-be2c-e37d0c43d12e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:06.477809 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a698ba-d23c-42cd-be2c-e37d0c43d12e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:06.484523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bbee3-56e3-4f89-812a-355a66aef1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:06.485143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bbee3-56e3-4f89-812a-355a66aef1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:06.485574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bbee3-56e3-4f89-812a-355a66aef1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:06.486054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bbee3-56e3-4f89-812a-355a66aef1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:06.486768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bbee3-56e3-4f89-812a-355a66aef1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:06.488918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bbee3-56e3-4f89-812a-355a66aef1e0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:06.505539 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1186/2396] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:06.506640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791af57c-5976-47e9-996b-08074084278a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:06.517968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791af57c-5976-47e9-996b-08074084278a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:06.523870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6cac0-4a8d-43ea-ab20-9cfc628f7fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:06.524469 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6cac0-4a8d-43ea-ab20-9cfc628f7fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:06.524747 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6cac0-4a8d-43ea-ab20-9cfc628f7fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:06.525059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6cac0-4a8d-43ea-ab20-9cfc628f7fc4 admin admin] PATH_INFO: `/v3/projects/2a429ec90ead438dbed35769b38131fc/users/f8564d2099cf44df96a2355144ba9fe6/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:06.541427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6cac0-4a8d-43ea-ab20-9cfc628f7fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a429ec90ead438dbed35769b38131fc, user_id=f8564d2099cf44df96a2355144ba9fe6, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:06.544048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6cac0-4a8d-43ea-ab20-9cfc628f7fc4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:06.588872 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:06.595470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1211/2397] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:06 2022] PUT /identity/v3/projects/2a429ec90ead438dbed35769b38131fc/users/f8564d2099cf44df96a2355144ba9fe6/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:06.606608 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0643f-0628-4cba-96a3-18ae6eabd995 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:06.607070 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0643f-0628-4cba-96a3-18ae6eabd995 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:06.607389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0643f-0628-4cba-96a3-18ae6eabd995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:06.636801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-59f0643f-0628-4cba-96a3-18ae6eabd995 None None] MFA Rules not processed for user `f8564d2099cf44df96a2355144ba9fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:06.638135 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-59f0643f-0628-4cba-96a3-18ae6eabd995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:06.704954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1187/2398] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:06.717013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6cac0-4a8d-43ea-ab20-9cfc628f7fc4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:06.718854 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-acc6cac0-4a8d-43ea-ab20-9cfc628f7fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:06.794915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6cac0-4a8d-43ea-ab20-9cfc628f7fc4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:06.800670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b7aac-d474-445b-a22a-05502fd31fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:06.801281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7aac-d474-445b-a22a-05502fd31fe1 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:06.801585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7aac-d474-445b-a22a-05502fd31fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:06.801852 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7aac-d474-445b-a22a-05502fd31fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:06.810036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b7aac-d474-445b-a22a-05502fd31fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:06.812232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b7aac-d474-445b-a22a-05502fd31fe1 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:06.821842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1212/2399] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:07.094195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0643f-0628-4cba-96a3-18ae6eabd995 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:07.163579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:07.178357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0643f-0628-4cba-96a3-18ae6eabd995 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:07.183717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:07.184466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:07.184847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:07.185221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] PATH_INFO: `/v3/users/f8564d2099cf44df96a2355144ba9fe6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:07.187045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8564d2099cf44df96a2355144ba9fe6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:07.189074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:07.438846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8564d2099cf44df96a2355144ba9fe6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:07.439511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8564d2099cf44df96a2355144ba9fe6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:07.452553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8564d2099cf44df96a2355144ba9fe6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:07.473339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8564d2099cf44df96a2355144ba9fe6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:07.550121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8564d2099cf44df96a2355144ba9fe6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:07.556888 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1188/2400] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:07 2022] DELETE /identity/v3/users/f8564d2099cf44df96a2355144ba9fe6 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:07.562287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdf79d-b1a9-42bd-8894-49f99bcd7df7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:07.562795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdf79d-b1a9-42bd-8894-49f99bcd7df7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:07.563072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdf79d-b1a9-42bd-8894-49f99bcd7df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:07.583085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b7fdf79d-b1a9-42bd-8894-49f99bcd7df7 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:07.584316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b7fdf79d-b1a9-42bd-8894-49f99bcd7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:07.653554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1213/2401] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:07.669645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:07.673657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:07.764878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2e927-db25-49ec-b4f5-82686b729395 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:07.769888 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f77cad-fe83-4797-9947-542df3d8833d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:07.770573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77cad-fe83-4797-9947-542df3d8833d service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:07.770977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77cad-fe83-4797-9947-542df3d8833d service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:07.771207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f77cad-fe83-4797-9947-542df3d8833d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:07.783558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f77cad-fe83-4797-9947-542df3d8833d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:07.785337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f77cad-fe83-4797-9947-542df3d8833d service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:07.796597 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1189/2402] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:08.320843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdf79d-b1a9-42bd-8894-49f99bcd7df7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:08.322860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b7fdf79d-b1a9-42bd-8894-49f99bcd7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:08.344565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdf79d-b1a9-42bd-8894-49f99bcd7df7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:08.353278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:08.354430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:08.354900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:08.355324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] PATH_INFO: `/v3/projects/2a429ec90ead438dbed35769b38131fc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:08.356930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a429ec90ead438dbed35769b38131fc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:08.365519 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:08.517416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f77cad-fe83-4797-9947-542df3d8833d service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:08.519566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-28f77cad-fe83-4797-9947-542df3d8833d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:08.522103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a429ec90ead438dbed35769b38131fc', 'request_id': 'req-52293114-a93d-4e59-a313-9067696f1bdd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:08.531654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a429ec90ead438dbed35769b38131fc', 'request_id': 'req-52293114-a93d-4e59-a313-9067696f1bdd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:08.533337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f77cad-fe83-4797-9947-542df3d8833d service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:08.538134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a429ec90ead438dbed35769b38131fc', 'request_id': 'req-52293114-a93d-4e59-a313-9067696f1bdd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:08.591879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:08.592532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:08.592811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:08.593082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] PATH_INFO: `/v3/users/07b2fcfa197e4e93852c9a04aa8f008a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:08.594332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b2fcfa197e4e93852c9a04aa8f008a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:08.596246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:08.608912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:08.640922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] The token cache is being invalidate because project 2a429ec90ead438dbed35769b38131fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:08.641207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:08.641849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-52293114-a93d-4e59-a313-9067696f1bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:08.643622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1214/2403] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:08 2022] DELETE /identity/v3/projects/2a429ec90ead438dbed35769b38131fc => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:08.648220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7d6d0-a492-43b0-8352-808d4d8bd876 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:08.648501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7d6d0-a492-43b0-8352-808d4d8bd876 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:08.648773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7d6d0-a492-43b0-8352-808d4d8bd876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:08.668095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-05d7d6d0-a492-43b0-8352-808d4d8bd876 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:08.669251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-05d7d6d0-a492-43b0-8352-808d4d8bd876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:08.677741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1215/2404] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:08.687107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810e5d2-320d-40b5-9e96-82723987ecf3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:08.687381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810e5d2-320d-40b5-9e96-82723987ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:08.687652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810e5d2-320d-40b5-9e96-82723987ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:08.694995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:08.708779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7810e5d2-320d-40b5-9e96-82723987ecf3 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:08.712198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7810e5d2-320d-40b5-9e96-82723987ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:08.721850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1216/2405] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:08.722755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810e5d2-320d-40b5-9e96-82723987ecf3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:08.731895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810e5d2-320d-40b5-9e96-82723987ecf3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:08.737200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fbb12-95ca-4e07-9018-24ec5d2c98d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:08.737876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fbb12-95ca-4e07-9018-24ec5d2c98d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:08.738144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fbb12-95ca-4e07-9018-24ec5d2c98d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:08.738414 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fbb12-95ca-4e07-9018-24ec5d2c98d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:08.739153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fbb12-95ca-4e07-9018-24ec5d2c98d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:08.739445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fbb12-95ca-4e07-9018-24ec5d2c98d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:08.741104 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fbb12-95ca-4e07-9018-24ec5d2c98d0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:08.761764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1217/2406] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:30:08.768595 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fbb12-95ca-4e07-9018-24ec5d2c98d0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:08.774750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b2fcfa197e4e93852c9a04aa8f008a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:08.775406 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b2fcfa197e4e93852c9a04aa8f008a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:08.778584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fbb12-95ca-4e07-9018-24ec5d2c98d0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:08.783908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b2fcfa197e4e93852c9a04aa8f008a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:08.784753 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63839662-7d83-4618-98e4-3a1e3f7a00ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:08.785526 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63839662-7d83-4618-98e4-3a1e3f7a00ea admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:08.785874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63839662-7d83-4618-98e4-3a1e3f7a00ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:08.786262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63839662-7d83-4618-98e4-3a1e3f7a00ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:08.786947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63839662-7d83-4618-98e4-3a1e3f7a00ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:08.789024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63839662-7d83-4618-98e4-3a1e3f7a00ea admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:08.797709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b2fcfa197e4e93852c9a04aa8f008a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:08.887794 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b2fcfa197e4e93852c9a04aa8f008a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:08.898178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1218/2407] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:08 2022] POST /identity/v3/projects => generated 403 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:08.903402 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63839662-7d83-4618-98e4-3a1e3f7a00ea admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:08.905637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-63839662-7d83-4618-98e4-3a1e3f7a00ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:08.907097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1190/2408] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:08 2022] DELETE /identity/v3/users/07b2fcfa197e4e93852c9a04aa8f008a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:08.973939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63839662-7d83-4618-98e4-3a1e3f7a00ea admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:08.978767 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0bac1-bdf8-4bce-aa43-08f27fbf87e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:08.979378 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0bac1-bdf8-4bce-aa43-08f27fbf87e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:08.979653 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0bac1-bdf8-4bce-aa43-08f27fbf87e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:08.979953 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0bac1-bdf8-4bce-aa43-08f27fbf87e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:08.980542 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0bac1-bdf8-4bce-aa43-08f27fbf87e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:08.982571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0bac1-bdf8-4bce-aa43-08f27fbf87e4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:09.086063 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1219/2409] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:08 2022] POST /identity/v3/users => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:09.090481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:09.152783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ae0d7-3f27-45b5-a6c2-a9118085e81e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:09.158453 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ada1-a32c-491b-89ea-44b9f72f9b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:09.159051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ada1-a32c-491b-89ea-44b9f72f9b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.159324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ada1-a32c-491b-89ea-44b9f72f9b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.159592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ada1-a32c-491b-89ea-44b9f72f9b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.160256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6ada1-a32c-491b-89ea-44b9f72f9b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:09.161889 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6ada1-a32c-491b-89ea-44b9f72f9b5d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:09.168955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0bac1-bdf8-4bce-aa43-08f27fbf87e4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:09.171365 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b8c0bac1-bdf8-4bce-aa43-08f27fbf87e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:09.176854 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1191/2410] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:09.177774 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ada1-a32c-491b-89ea-44b9f72f9b5d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:09.188560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ada1-a32c-491b-89ea-44b9f72f9b5d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:09.189084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0bac1-bdf8-4bce-aa43-08f27fbf87e4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:09.194995 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ea428-4a81-44b2-9f63-8a1b0daa51a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:09.195373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:09.195616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ea428-4a81-44b2-9f63-8a1b0daa51a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.195890 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ea428-4a81-44b2-9f63-8a1b0daa51a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.196117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.196331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.196496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ea428-4a81-44b2-9f63-8a1b0daa51a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.196603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] PATH_INFO: `/v3/projects/873132bc2d52427eace2fb03ad6355aa` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.197148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ea428-4a81-44b2-9f63-8a1b0daa51a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:09.199981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ea428-4a81-44b2-9f63-8a1b0daa51a7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:09.200120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=873132bc2d52427eace2fb03ad6355aa)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:09.202821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:09.211517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1192/2411] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:09.220003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ea428-4a81-44b2-9f63-8a1b0daa51a7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:09.231217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ea428-4a81-44b2-9f63-8a1b0daa51a7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:09.237550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02455f01-d4cc-4dd4-a97a-81a300d4d151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:09.238592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02455f01-d4cc-4dd4-a97a-81a300d4d151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.239106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02455f01-d4cc-4dd4-a97a-81a300d4d151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.239378 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02455f01-d4cc-4dd4-a97a-81a300d4d151 admin admin] PATH_INFO: `/v3/projects/85bcd96d82524858af61202015361d6b/users/ab4a4fdb04b346c7a49449392f124015/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.254556 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02455f01-d4cc-4dd4-a97a-81a300d4d151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bcd96d82524858af61202015361d6b, user_id=ab4a4fdb04b346c7a49449392f124015, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:09.257186 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02455f01-d4cc-4dd4-a97a-81a300d4d151 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:09.365564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1193/2412] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:09 2022] PUT /identity/v3/projects/85bcd96d82524858af61202015361d6b/users/ab4a4fdb04b346c7a49449392f124015/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:09.375137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e20dec-fe9e-4e84-a5df-6cc8457263a0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.375422 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e20dec-fe9e-4e84-a5df-6cc8457263a0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.375693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e20dec-fe9e-4e84-a5df-6cc8457263a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.379901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873132bc2d52427eace2fb03ad6355aa', 'request_id': 'req-47fe7745-204f-4006-80b0-a10c65d74b9f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:09.386218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873132bc2d52427eace2fb03ad6355aa', 'request_id': 'req-47fe7745-204f-4006-80b0-a10c65d74b9f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:09.403069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873132bc2d52427eace2fb03ad6355aa', 'request_id': 'req-47fe7745-204f-4006-80b0-a10c65d74b9f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:09.418204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-81e20dec-fe9e-4e84-a5df-6cc8457263a0 None None] MFA Rules not processed for user `ab4a4fdb04b346c7a49449392f124015`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:09.419435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-81e20dec-fe9e-4e84-a5df-6cc8457263a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:09.485053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1194/2413] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:09.485706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] The token cache is being invalidate because project 873132bc2d52427eace2fb03ad6355aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:09.485997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:09.486639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-47fe7745-204f-4006-80b0-a10c65d74b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:09.488117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1220/2414] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:09 2022] DELETE /identity/v3/projects/873132bc2d52427eace2fb03ad6355aa => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:09.489571 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e20dec-fe9e-4e84-a5df-6cc8457263a0 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:09.492612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44574-5623-403b-9d47-c359d0946524 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.492891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44574-5623-403b-9d47-c359d0946524 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.493161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44574-5623-403b-9d47-c359d0946524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.512361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b4a44574-5623-403b-9d47-c359d0946524 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:09.516684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b4a44574-5623-403b-9d47-c359d0946524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:09.554864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e20dec-fe9e-4e84-a5df-6cc8457263a0 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:09.559545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d466389-7e03-4eda-a357-7c07ee0bf9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:09.560235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d466389-7e03-4eda-a357-7c07ee0bf9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.562780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:09.563296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d466389-7e03-4eda-a357-7c07ee0bf9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.563632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d466389-7e03-4eda-a357-7c07ee0bf9b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.564475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d466389-7e03-4eda-a357-7c07ee0bf9b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:09.566328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d466389-7e03-4eda-a357-7c07ee0bf9b1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:09.572723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1221/2415] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:09.581818 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4142e-d89f-4020-9651-19494cb86d2d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.582145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4142e-d89f-4020-9651-19494cb86d2d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.582407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4142e-d89f-4020-9651-19494cb86d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.591290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:09.602959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d3b4142e-d89f-4020-9651-19494cb86d2d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:09.604128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d3b4142e-d89f-4020-9651-19494cb86d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:09.621554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1222/2416] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:09.624814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4142e-d89f-4020-9651-19494cb86d2d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:09.634179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4142e-d89f-4020-9651-19494cb86d2d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:09.639667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0070a3-3578-4539-9df2-2ed7706ed1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:09.640269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0070a3-3578-4539-9df2-2ed7706ed1da admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.640542 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0070a3-3578-4539-9df2-2ed7706ed1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.640806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0070a3-3578-4539-9df2-2ed7706ed1da admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.641693 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0070a3-3578-4539-9df2-2ed7706ed1da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:09.641998 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0070a3-3578-4539-9df2-2ed7706ed1da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:09.644974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0070a3-3578-4539-9df2-2ed7706ed1da admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:09.656499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1195/2417] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:09 2022] POST /identity/v3/projects => generated 405 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:09.659627 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1223/2418] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:09.660631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d466389-7e03-4eda-a357-7c07ee0bf9b1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:09.662702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8d466389-7e03-4eda-a357-7c07ee0bf9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:09.663936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0070a3-3578-4539-9df2-2ed7706ed1da admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:09.677332 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0070a3-3578-4539-9df2-2ed7706ed1da admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:09.744759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d466389-7e03-4eda-a357-7c07ee0bf9b1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:09.752128 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa0871-624c-476f-a574-6dceef35bef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:09.752996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0871-624c-476f-a574-6dceef35bef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.753491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0871-624c-476f-a574-6dceef35bef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.753978 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0871-624c-476f-a574-6dceef35bef2 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.754780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa0871-624c-476f-a574-6dceef35bef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:09.757536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa0871-624c-476f-a574-6dceef35bef2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:09.758562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0b27d-c769-47be-8ca4-80d0a60f85e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:09.759256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0b27d-c769-47be-8ca4-80d0a60f85e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.759632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0b27d-c769-47be-8ca4-80d0a60f85e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.760210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0b27d-c769-47be-8ca4-80d0a60f85e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.761070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0b27d-c769-47be-8ca4-80d0a60f85e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:09.763213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0b27d-c769-47be-8ca4-80d0a60f85e8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:09.877807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1196/2419] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:09 2022] POST /identity/v3/users => generated 309 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:09.880992 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa0871-624c-476f-a574-6dceef35bef2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:09.892594 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa0871-624c-476f-a574-6dceef35bef2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:09.905609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ac7b9-a7c9-45ec-934b-42ebdb3fb022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:09.909043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac7b9-a7c9-45ec-934b-42ebdb3fb022 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.909188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1224/2420] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:09 2022] POST /identity/v3/projects => generated 357 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:09.909309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac7b9-a7c9-45ec-934b-42ebdb3fb022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.909309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac7b9-a7c9-45ec-934b-42ebdb3fb022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.909518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0b27d-c769-47be-8ca4-80d0a60f85e8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:09.909613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ac7b9-a7c9-45ec-934b-42ebdb3fb022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:09.909613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ac7b9-a7c9-45ec-934b-42ebdb3fb022 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:09.912928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ebc0b27d-c769-47be-8ca4-80d0a60f85e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:09.921288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1197/2421] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:09.922130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ac7b9-a7c9-45ec-934b-42ebdb3fb022 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:09.932075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ac7b9-a7c9-45ec-934b-42ebdb3fb022 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:09.983070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0b27d-c769-47be-8ca4-80d0a60f85e8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:09.986825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48d413-1163-4268-b5c5-a76f617217d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:09.987433 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48d413-1163-4268-b5c5-a76f617217d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.987709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48d413-1163-4268-b5c5-a76f617217d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.987979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48d413-1163-4268-b5c5-a76f617217d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.989747 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3f48d413-1163-4268-b5c5-a76f617217d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:09.995678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b63760-0ad5-461e-9023-e3e8745036f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:09.996208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63760-0ad5-461e-9023-e3e8745036f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:09.996484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63760-0ad5-461e-9023-e3e8745036f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:09.996752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63760-0ad5-461e-9023-e3e8745036f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:09.997374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b63760-0ad5-461e-9023-e3e8745036f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:09.999349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b63760-0ad5-461e-9023-e3e8745036f3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.041608 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:10.053048 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48d413-1163-4268-b5c5-a76f617217d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.054581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48d413-1163-4268-b5c5-a76f617217d5 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.064523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1225/2422] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:10.065276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48d413-1163-4268-b5c5-a76f617217d5 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.074266 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48d413-1163-4268-b5c5-a76f617217d5 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.080543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a003b-d9d5-43ce-bc41-521791ee7222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.081274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a003b-d9d5-43ce-bc41-521791ee7222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.081639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a003b-d9d5-43ce-bc41-521791ee7222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.081970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a003b-d9d5-43ce-bc41-521791ee7222 admin admin] PATH_INFO: `/v3/projects/360f44fae5e640cf8800c8da04e4a306/users/7bc6dc29216444b3adafe8291259c2d6/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.093936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1198/2423] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:09 2022] POST /identity/v3/users => generated 279 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:10.098240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b63760-0ad5-461e-9023-e3e8745036f3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.100003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a003b-d9d5-43ce-bc41-521791ee7222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=360f44fae5e640cf8800c8da04e4a306, user_id=7bc6dc29216444b3adafe8291259c2d6, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.102882 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a003b-d9d5-43ce-bc41-521791ee7222 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.109415 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b63760-0ad5-461e-9023-e3e8745036f3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.114519 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bf781-0346-4210-887d-65f58156f5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.115142 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bf781-0346-4210-887d-65f58156f5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.115449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bf781-0346-4210-887d-65f58156f5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.115721 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bf781-0346-4210-887d-65f58156f5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.116371 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bf781-0346-4210-887d-65f58156f5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.117318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:10.118004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bf781-0346-4210-887d-65f58156f5e9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.130075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1199/2424] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:10.134110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bf781-0346-4210-887d-65f58156f5e9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.144319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bf781-0346-4210-887d-65f58156f5e9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.149019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb0268-77b6-4265-b774-73565ef025b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.149637 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb0268-77b6-4265-b774-73565ef025b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.149910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb0268-77b6-4265-b774-73565ef025b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.150174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb0268-77b6-4265-b774-73565ef025b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.150797 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb0268-77b6-4265-b774-73565ef025b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.152377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb0268-77b6-4265-b774-73565ef025b5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.162335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1200/2425] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:10.166433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb0268-77b6-4265-b774-73565ef025b5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.177063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb0268-77b6-4265-b774-73565ef025b5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.181940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebe17e-7590-4351-bb23-f0fcaf4f2729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.182701 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebe17e-7590-4351-bb23-f0fcaf4f2729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.189487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebe17e-7590-4351-bb23-f0fcaf4f2729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.189487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebe17e-7590-4351-bb23-f0fcaf4f2729 admin admin] PATH_INFO: `/v3/projects/8b7818e68fd9440c80ea4de646a839b7/users/d1dbdb3220194e6c8e99d165ab1775b9/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.197176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1226/2426] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:10 2022] PUT /identity/v3/projects/360f44fae5e640cf8800c8da04e4a306/users/7bc6dc29216444b3adafe8291259c2d6/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:10.201809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a003b-d9d5-43ce-bc41-521791ee7222 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.204166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebe17e-7590-4351-bb23-f0fcaf4f2729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7818e68fd9440c80ea4de646a839b7, user_id=d1dbdb3220194e6c8e99d165ab1775b9, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.206849 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebe17e-7590-4351-bb23-f0fcaf4f2729 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.268661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a003b-d9d5-43ce-bc41-521791ee7222 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.274111 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d84ba6-87d6-4210-81c3-9867137418ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.274725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84ba6-87d6-4210-81c3-9867137418ba admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.274998 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84ba6-87d6-4210-81c3-9867137418ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.275269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84ba6-87d6-4210-81c3-9867137418ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.275908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d84ba6-87d6-4210-81c3-9867137418ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.277540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d84ba6-87d6-4210-81c3-9867137418ba admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.287507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1227/2427] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:10.291939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d84ba6-87d6-4210-81c3-9867137418ba admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.299042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1201/2428] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:10 2022] PUT /identity/v3/projects/8b7818e68fd9440c80ea4de646a839b7/users/d1dbdb3220194e6c8e99d165ab1775b9/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:10.306149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d84ba6-87d6-4210-81c3-9867137418ba admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.309318 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdee77a-48a8-4b65-87ac-6c22e2a811b9 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.309651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdee77a-48a8-4b65-87ac-6c22e2a811b9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.309950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdee77a-48a8-4b65-87ac-6c22e2a811b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.343789 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-fbdee77a-48a8-4b65-87ac-6c22e2a811b9 None None] MFA Rules not processed for user `d1dbdb3220194e6c8e99d165ab1775b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:10.345123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fbdee77a-48a8-4b65-87ac-6c22e2a811b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:10.378273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d25d3-487c-4a79-8129-40aeca53ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.379348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d25d3-487c-4a79-8129-40aeca53ff37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.379348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d25d3-487c-4a79-8129-40aeca53ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.379555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d25d3-487c-4a79-8129-40aeca53ff37 admin admin] PATH_INFO: `/v3/projects/360f44fae5e640cf8800c8da04e4a306/users/7bc6dc29216444b3adafe8291259c2d6/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.382058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d25d3-487c-4a79-8129-40aeca53ff37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=360f44fae5e640cf8800c8da04e4a306, user_id=7bc6dc29216444b3adafe8291259c2d6, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.385018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d25d3-487c-4a79-8129-40aeca53ff37 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.401426 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1228/2429] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:10 2022] PUT /identity/v3/projects/360f44fae5e640cf8800c8da04e4a306/users/7bc6dc29216444b3adafe8291259c2d6/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:10.411929 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c3c3-bbb0-472c-b0e3-4f31edd643af None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.412212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c3c3-bbb0-472c-b0e3-4f31edd643af None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.412491 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c3c3-bbb0-472c-b0e3-4f31edd643af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.429886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1202/2430] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:10.431437 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdee77a-48a8-4b65-87ac-6c22e2a811b9 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.443965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fd88c3c3-bbb0-472c-b0e3-4f31edd643af None None] MFA Rules not processed for user `7bc6dc29216444b3adafe8291259c2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:10.444703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdee77a-48a8-4b65-87ac-6c22e2a811b9 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.445176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fd88c3c3-bbb0-472c-b0e3-4f31edd643af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:10.497502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:10.508855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a662f58-b934-449c-9bf3-79bbecf739fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.509937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a662f58-b934-449c-9bf3-79bbecf739fa admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.510373 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a662f58-b934-449c-9bf3-79bbecf739fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.510752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a662f58-b934-449c-9bf3-79bbecf739fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.512771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a662f58-b934-449c-9bf3-79bbecf739fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.513480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a662f58-b934-449c-9bf3-79bbecf739fa admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.530969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1229/2431] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:10.542017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88c3c3-bbb0-472c-b0e3-4f31edd643af None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.543481 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fd88c3c3-bbb0-472c-b0e3-4f31edd643af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:10.601135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88c3c3-bbb0-472c-b0e3-4f31edd643af None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.604833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd89dc-e26a-4bda-a1aa-d5781fd50d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.605528 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd89dc-e26a-4bda-a1aa-d5781fd50d34 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.605794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd89dc-e26a-4bda-a1aa-d5781fd50d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.606070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd89dc-e26a-4bda-a1aa-d5781fd50d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.618353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd89dc-e26a-4bda-a1aa-d5781fd50d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.620075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd89dc-e26a-4bda-a1aa-d5781fd50d34 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.622369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1203/2432] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:10 2022] POST /identity/v3/projects => generated 355 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:10.627375 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a662f58-b934-449c-9bf3-79bbecf739fa admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.631895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:10.636859 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1230/2433] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:10 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:10.697572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a662f58-b934-449c-9bf3-79bbecf739fa admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.703494 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2704d-dd00-4da2-9d76-0c42f6457340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.704115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2704d-dd00-4da2-9d76-0c42f6457340 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.704392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2704d-dd00-4da2-9d76-0c42f6457340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.704661 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2704d-dd00-4da2-9d76-0c42f6457340 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.705280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2704d-dd00-4da2-9d76-0c42f6457340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.707622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2704d-dd00-4da2-9d76-0c42f6457340 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.799461 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd89dc-e26a-4bda-a1aa-d5781fd50d34 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.807402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1204/2434] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:10 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:10.812550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2704d-dd00-4da2-9d76-0c42f6457340 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.815980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd89dc-e26a-4bda-a1aa-d5781fd50d34 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.822179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d80dd9-9e62-40e7-a684-3b3e915c5574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.822999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d80dd9-9e62-40e7-a684-3b3e915c5574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.823496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d80dd9-9e62-40e7-a684-3b3e915c5574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.823617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2704d-dd00-4da2-9d76-0c42f6457340 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.824040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d80dd9-9e62-40e7-a684-3b3e915c5574 admin admin] PATH_INFO: `/v3/users/ab4a4fdb04b346c7a49449392f124015` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.826841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d80dd9-9e62-40e7-a684-3b3e915c5574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4a4fdb04b346c7a49449392f124015)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.829200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d80dd9-9e62-40e7-a684-3b3e915c5574 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.832415 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b151e-ba0f-4e4a-b512-f9c6d86cb83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.833228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b151e-ba0f-4e4a-b512-f9c6d86cb83a admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.833228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b151e-ba0f-4e4a-b512-f9c6d86cb83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.833540 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b151e-ba0f-4e4a-b512-f9c6d86cb83a admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.836157 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b151e-ba0f-4e4a-b512-f9c6d86cb83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.837903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b151e-ba0f-4e4a-b512-f9c6d86cb83a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.851966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1205/2435] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:10.856463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b151e-ba0f-4e4a-b512-f9c6d86cb83a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:10.868211 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b151e-ba0f-4e4a-b512-f9c6d86cb83a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:10.873004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93015b-f061-4d2d-b09f-63a9d6fedd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:10.873993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93015b-f061-4d2d-b09f-63a9d6fedd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:10.874357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93015b-f061-4d2d-b09f-63a9d6fedd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:10.874699 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93015b-f061-4d2d-b09f-63a9d6fedd25 admin admin] PATH_INFO: `/v3/projects/1c49e748737c44989bc512fd56c36d22/users/acf486af8d1945a99f629466f5305da2/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:10.890960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93015b-f061-4d2d-b09f-63a9d6fedd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c49e748737c44989bc512fd56c36d22, user_id=acf486af8d1945a99f629466f5305da2, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:10.893938 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93015b-f061-4d2d-b09f-63a9d6fedd25 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:10.978684 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1206/2436] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:10 2022] PUT /identity/v3/projects/1c49e748737c44989bc512fd56c36d22/users/acf486af8d1945a99f629466f5305da2/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:10.982427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93015b-f061-4d2d-b09f-63a9d6fedd25 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:11.016216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03d80dd9-9e62-40e7-a684-3b3e915c5574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4a4fdb04b346c7a49449392f124015'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:11.016867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03d80dd9-9e62-40e7-a684-3b3e915c5574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4a4fdb04b346c7a49449392f124015'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:11.029600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03d80dd9-9e62-40e7-a684-3b3e915c5574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4a4fdb04b346c7a49449392f124015'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:11.037070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03d80dd9-9e62-40e7-a684-3b3e915c5574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4a4fdb04b346c7a49449392f124015'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:11.037743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03d80dd9-9e62-40e7-a684-3b3e915c5574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4a4fdb04b346c7a49449392f124015'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:11.047422 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93015b-f061-4d2d-b09f-63a9d6fedd25 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:11.052653 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065cf8b-f5b2-48d0-b94c-926ed2ff83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:11.053271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065cf8b-f5b2-48d0-b94c-926ed2ff83c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:11.053560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065cf8b-f5b2-48d0-b94c-926ed2ff83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:11.053861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065cf8b-f5b2-48d0-b94c-926ed2ff83c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:11.054500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065cf8b-f5b2-48d0-b94c-926ed2ff83c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:11.056089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065cf8b-f5b2-48d0-b94c-926ed2ff83c0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:11.072733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1207/2437] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:11.073826 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065cf8b-f5b2-48d0-b94c-926ed2ff83c0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:11.075624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7065cf8b-f5b2-48d0-b94c-926ed2ff83c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:11.097505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065cf8b-f5b2-48d0-b94c-926ed2ff83c0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:11.102444 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab2a4f-0011-4b24-9513-d55c505dffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:11.103227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab2a4f-0011-4b24-9513-d55c505dffe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:11.103551 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab2a4f-0011-4b24-9513-d55c505dffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:11.109506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab2a4f-0011-4b24-9513-d55c505dffe3 admin admin] PATH_INFO: `/v3/projects/1c49e748737c44989bc512fd56c36d22/users/acf486af8d1945a99f629466f5305da2/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:11.109506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab2a4f-0011-4b24-9513-d55c505dffe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c49e748737c44989bc512fd56c36d22, user_id=acf486af8d1945a99f629466f5305da2, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:11.109506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab2a4f-0011-4b24-9513-d55c505dffe3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:11.120829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1208/2438] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:11 2022] PUT /identity/v3/projects/1c49e748737c44989bc512fd56c36d22/users/acf486af8d1945a99f629466f5305da2/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:11.131268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e63fc-384e-4781-ba14-098211f472d2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:11.131769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e63fc-384e-4781-ba14-098211f472d2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:11.132274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e63fc-384e-4781-ba14-098211f472d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:11.137220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1231/2439] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:10 2022] DELETE /identity/v3/users/ab4a4fdb04b346c7a49449392f124015 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:11.142130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b63509-71fd-4963-87d3-800e933f5a50 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:11.142493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b63509-71fd-4963-87d3-800e933f5a50 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:11.143110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b63509-71fd-4963-87d3-800e933f5a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:11.167985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d5b63509-71fd-4963-87d3-800e933f5a50 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:11.169386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d5b63509-71fd-4963-87d3-800e933f5a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:11.169587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6f7e63fc-384e-4781-ba14-098211f472d2 None None] MFA Rules not processed for user `acf486af8d1945a99f629466f5305da2`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:11.171048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6f7e63fc-384e-4781-ba14-098211f472d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:11.213204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:11.240905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:11.257584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1232/2440] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:11.273094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b63509-71fd-4963-87d3-800e933f5a50 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:11.273681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1209/2441] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:11.275285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d5b63509-71fd-4963-87d3-800e933f5a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:11.289676 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e63fc-384e-4781-ba14-098211f472d2 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:11.291212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6f7e63fc-384e-4781-ba14-098211f472d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:11.340617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b63509-71fd-4963-87d3-800e933f5a50 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:11.346652 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee20721-fd4e-4ead-b911-767df1ccd130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:11.347508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee20721-fd4e-4ead-b911-767df1ccd130 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:11.347966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee20721-fd4e-4ead-b911-767df1ccd130 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:11.348409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee20721-fd4e-4ead-b911-767df1ccd130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:11.361523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e63fc-384e-4781-ba14-098211f472d2 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:11.361722 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee20721-fd4e-4ead-b911-767df1ccd130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:11.362961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee20721-fd4e-4ead-b911-767df1ccd130 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:11.367507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988d2ef-ce01-40d6-8a28-04684081b100 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:11.367507 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988d2ef-ce01-40d6-8a28-04684081b100 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:11.367753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988d2ef-ce01-40d6-8a28-04684081b100 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:11.368230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988d2ef-ce01-40d6-8a28-04684081b100 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:11.374439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1233/2442] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:11.378923 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988d2ef-ce01-40d6-8a28-04684081b100 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:11.380364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988d2ef-ce01-40d6-8a28-04684081b100 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:11.391624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1210/2443] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:11.619443 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee20721-fd4e-4ead-b911-767df1ccd130 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:11.626980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee20721-fd4e-4ead-b911-767df1ccd130 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:11.630612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576474f-341c-4d10-86b9-c9a136abc210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:11.631502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576474f-341c-4d10-86b9-c9a136abc210 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:11.631502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576474f-341c-4d10-86b9-c9a136abc210 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:11.631866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576474f-341c-4d10-86b9-c9a136abc210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:11.633555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2576474f-341c-4d10-86b9-c9a136abc210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:11.719107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576474f-341c-4d10-86b9-c9a136abc210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:11.720761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576474f-341c-4d10-86b9-c9a136abc210 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:11.731075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1234/2444] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:11.902536 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988d2ef-ce01-40d6-8a28-04684081b100 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:11.907678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8988d2ef-ce01-40d6-8a28-04684081b100 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:11.922839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988d2ef-ce01-40d6-8a28-04684081b100 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:11.927574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:11.928185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:11.928503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:11.928728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] PATH_INFO: `/v3/projects/85bcd96d82524858af61202015361d6b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:11.929873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bcd96d82524858af61202015361d6b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:11.931778 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:12.081593 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bcd96d82524858af61202015361d6b', 'request_id': 'req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:12.089744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bcd96d82524858af61202015361d6b', 'request_id': 'req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:12.177448 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bcd96d82524858af61202015361d6b', 'request_id': 'req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:12.190502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] The token cache is being invalidate because project 85bcd96d82524858af61202015361d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:12.190502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:12.191269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:12.192964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1211/2445] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:11 2022] DELETE /identity/v3/projects/85bcd96d82524858af61202015361d6b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:12.197083 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576474f-341c-4d10-86b9-c9a136abc210 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:12.210681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576474f-341c-4d10-86b9-c9a136abc210 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:12.290710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f521274-8a56-4418-a019-07cd16219a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:12.291911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f521274-8a56-4418-a019-07cd16219a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:12.292254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f521274-8a56-4418-a019-07cd16219a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:12.292594 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f521274-8a56-4418-a019-07cd16219a5d admin admin] PATH_INFO: `/v3/users/7bc6dc29216444b3adafe8291259c2d6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:12.294296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f521274-8a56-4418-a019-07cd16219a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc6dc29216444b3adafe8291259c2d6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:12.297994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f521274-8a56-4418-a019-07cd16219a5d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:12.530142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:12.536323 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3f521274-8a56-4418-a019-07cd16219a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc6dc29216444b3adafe8291259c2d6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:12.539189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3f521274-8a56-4418-a019-07cd16219a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc6dc29216444b3adafe8291259c2d6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:12.551218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3f521274-8a56-4418-a019-07cd16219a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc6dc29216444b3adafe8291259c2d6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:12.558228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3f521274-8a56-4418-a019-07cd16219a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc6dc29216444b3adafe8291259c2d6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:12.559102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3f521274-8a56-4418-a019-07cd16219a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc6dc29216444b3adafe8291259c2d6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:12.624100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1235/2446] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:12 2022] DELETE /identity/v3/users/7bc6dc29216444b3adafe8291259c2d6 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:13.178563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:13.179145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:13.197099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ba0c0-e08a-4c4c-8cea-ce8b361a97d4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:13.277034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:13.292007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:13.292754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:13.294307 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:13.305306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] PATH_INFO: `/v3/projects/360f44fae5e640cf8800c8da04e4a306` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:13.305306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=360f44fae5e640cf8800c8da04e4a306)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:13.305306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:13.457983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '360f44fae5e640cf8800c8da04e4a306', 'request_id': 'req-f3fd8850-aeb9-442f-9882-af47fd888963'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:13.467932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '360f44fae5e640cf8800c8da04e4a306', 'request_id': 'req-f3fd8850-aeb9-442f-9882-af47fd888963'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:13.590462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '360f44fae5e640cf8800c8da04e4a306', 'request_id': 'req-f3fd8850-aeb9-442f-9882-af47fd888963'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:13.613090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] The token cache is being invalidate because project 360f44fae5e640cf8800c8da04e4a306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:13.618718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:13.618718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f3fd8850-aeb9-442f-9882-af47fd888963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:13.618931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1212/2447] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:13 2022] DELETE /identity/v3/projects/360f44fae5e640cf8800c8da04e4a306 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:13.624037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930135c-1f09-44b5-a72d-8e730bd3c77f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:13.624275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930135c-1f09-44b5-a72d-8e730bd3c77f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:13.625565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930135c-1f09-44b5-a72d-8e730bd3c77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:13.650611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c930135c-1f09-44b5-a72d-8e730bd3c77f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:13.652300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c930135c-1f09-44b5-a72d-8e730bd3c77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:13.740010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1236/2448] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:13.749699 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823f138-0d10-4060-a4b2-2af02d2297fe None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:13.750005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823f138-0d10-4060-a4b2-2af02d2297fe None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:13.750262 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823f138-0d10-4060-a4b2-2af02d2297fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:13.773705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b823f138-0d10-4060-a4b2-2af02d2297fe None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:13.775006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b823f138-0d10-4060-a4b2-2af02d2297fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:13.784045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1213/2449] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:13.788498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930135c-1f09-44b5-a72d-8e730bd3c77f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:13.799149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930135c-1f09-44b5-a72d-8e730bd3c77f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:13.803956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dea75-4338-454d-9d11-145e05a84a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:13.804830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dea75-4338-454d-9d11-145e05a84a97 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:13.805107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dea75-4338-454d-9d11-145e05a84a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:13.805406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dea75-4338-454d-9d11-145e05a84a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:13.806120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820dea75-4338-454d-9d11-145e05a84a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:13.816374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820dea75-4338-454d-9d11-145e05a84a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:13.816374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820dea75-4338-454d-9d11-145e05a84a97 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:13.822106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1237/2450] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:13.826852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823f138-0d10-4060-a4b2-2af02d2297fe None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:13.836284 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823f138-0d10-4060-a4b2-2af02d2297fe None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:13.844161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9dea1-eb4f-497f-8d0e-fb5096b9ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:13.844970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9dea1-eb4f-497f-8d0e-fb5096b9ca85 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:13.845310 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9dea1-eb4f-497f-8d0e-fb5096b9ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:13.845616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9dea1-eb4f-497f-8d0e-fb5096b9ca85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:13.846254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9dea1-eb4f-497f-8d0e-fb5096b9ca85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:13.848409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9dea1-eb4f-497f-8d0e-fb5096b9ca85 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:13.929579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dea75-4338-454d-9d11-145e05a84a97 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:13.931363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-820dea75-4338-454d-9d11-145e05a84a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:13.944973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dea75-4338-454d-9d11-145e05a84a97 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:13.950909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8bd33-0ef3-411c-b457-fed673e21ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:13.952262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8bd33-0ef3-411c-b457-fed673e21ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:13.952422 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1214/2451] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:13 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:13.952895 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8bd33-0ef3-411c-b457-fed673e21ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:13.953836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8bd33-0ef3-411c-b457-fed673e21ba6 admin admin] PATH_INFO: `/v3/users/58d8aba7074e4a07b0e93107ea0b75cc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:13.955199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8bd33-0ef3-411c-b457-fed673e21ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d8aba7074e4a07b0e93107ea0b75cc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:13.956403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9dea1-eb4f-497f-8d0e-fb5096b9ca85 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:13.957276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8bd33-0ef3-411c-b457-fed673e21ba6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:14.020193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9dea1-eb4f-497f-8d0e-fb5096b9ca85 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:14.025147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996cdff-f992-4a1c-aaf1-0b3d43b77770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:14.025818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996cdff-f992-4a1c-aaf1-0b3d43b77770 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.026091 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996cdff-f992-4a1c-aaf1-0b3d43b77770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.026361 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996cdff-f992-4a1c-aaf1-0b3d43b77770 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.026969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996cdff-f992-4a1c-aaf1-0b3d43b77770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:14.028986 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996cdff-f992-4a1c-aaf1-0b3d43b77770 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:14.098274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1215/2452] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:13 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:14.102313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996cdff-f992-4a1c-aaf1-0b3d43b77770 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:14.111664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996cdff-f992-4a1c-aaf1-0b3d43b77770 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:14.116156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce09c4-1aa1-4b99-a8ae-5b1126f8de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:14.116718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce09c4-1aa1-4b99-a8ae-5b1126f8de81 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.116990 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce09c4-1aa1-4b99-a8ae-5b1126f8de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.117254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce09c4-1aa1-4b99-a8ae-5b1126f8de81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.117903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce09c4-1aa1-4b99-a8ae-5b1126f8de81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:14.119465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce09c4-1aa1-4b99-a8ae-5b1126f8de81 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:14.129999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1216/2453] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:14.133744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce09c4-1aa1-4b99-a8ae-5b1126f8de81 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:14.144162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce09c4-1aa1-4b99-a8ae-5b1126f8de81 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:14.148873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e052e9-e695-4c5a-ab7a-118f726f68cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:14.149474 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e052e9-e695-4c5a-ab7a-118f726f68cf admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.149746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e052e9-e695-4c5a-ab7a-118f726f68cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.150014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e052e9-e695-4c5a-ab7a-118f726f68cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.150623 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e052e9-e695-4c5a-ab7a-118f726f68cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:14.152221 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e052e9-e695-4c5a-ab7a-118f726f68cf admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:14.157656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e0d8bd33-0ef3-411c-b457-fed673e21ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d8aba7074e4a07b0e93107ea0b75cc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:14.158323 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e0d8bd33-0ef3-411c-b457-fed673e21ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d8aba7074e4a07b0e93107ea0b75cc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:14.166509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1217/2454] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:14.167374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e052e9-e695-4c5a-ab7a-118f726f68cf admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:14.169102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-21e052e9-e695-4c5a-ab7a-118f726f68cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:14.174153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e0d8bd33-0ef3-411c-b457-fed673e21ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d8aba7074e4a07b0e93107ea0b75cc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:14.181893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e052e9-e695-4c5a-ab7a-118f726f68cf admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:14.182613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e0d8bd33-0ef3-411c-b457-fed673e21ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d8aba7074e4a07b0e93107ea0b75cc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:14.183483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e0d8bd33-0ef3-411c-b457-fed673e21ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d8aba7074e4a07b0e93107ea0b75cc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:14.187267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7be50e-b905-4cd5-a904-2cd0386f93de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:14.188113 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7be50e-b905-4cd5-a904-2cd0386f93de admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.188408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7be50e-b905-4cd5-a904-2cd0386f93de admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.188679 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7be50e-b905-4cd5-a904-2cd0386f93de admin admin] PATH_INFO: `/v3/projects/5c7acb9e64ee47188ff39fd38ce4f518/users/1b0bf44b6f324804901084248a11b3bb/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.203952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7be50e-b905-4cd5-a904-2cd0386f93de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7acb9e64ee47188ff39fd38ce4f518, user_id=1b0bf44b6f324804901084248a11b3bb, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:14.206546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7be50e-b905-4cd5-a904-2cd0386f93de admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:14.209564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:14.258838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1238/2455] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:13 2022] DELETE /identity/v3/users/58d8aba7074e4a07b0e93107ea0b75cc => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:14.273341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1218/2456] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:14 2022] PUT /identity/v3/projects/5c7acb9e64ee47188ff39fd38ce4f518/users/1b0bf44b6f324804901084248a11b3bb/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:14.284556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b1c82-e65b-4d83-a8a7-f5c339bca021 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.284900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b1c82-e65b-4d83-a8a7-f5c339bca021 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.285316 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b1c82-e65b-4d83-a8a7-f5c339bca021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.322428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b80b1c82-e65b-4d83-a8a7-f5c339bca021 None None] MFA Rules not processed for user `1b0bf44b6f324804901084248a11b3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:14.324097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b80b1c82-e65b-4d83-a8a7-f5c339bca021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:14.329600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:14.406077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1239/2457] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:14.410728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7be50e-b905-4cd5-a904-2cd0386f93de admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:14.481659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7be50e-b905-4cd5-a904-2cd0386f93de admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:14.487510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e23e21-475a-42b3-8233-bb1bcd828d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:14.488202 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e23e21-475a-42b3-8233-bb1bcd828d6e admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.488492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e23e21-475a-42b3-8233-bb1bcd828d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.488761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e23e21-475a-42b3-8233-bb1bcd828d6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.489414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e23e21-475a-42b3-8233-bb1bcd828d6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:14.491579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e23e21-475a-42b3-8233-bb1bcd828d6e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:14.563437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b1c82-e65b-4d83-a8a7-f5c339bca021 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:14.564826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b80b1c82-e65b-4d83-a8a7-f5c339bca021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:14.574099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1219/2458] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:14 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:14.581859 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b1c82-e65b-4d83-a8a7-f5c339bca021 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:14.582869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e23e21-475a-42b3-8233-bb1bcd828d6e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:14.654164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:14.655474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.656168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.656168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] PATH_INFO: `/v3/projects/845556f2bf394dfe89bddf4be51b2336` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.657338 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=845556f2bf394dfe89bddf4be51b2336)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:14.659477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:14.669664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e23e21-475a-42b3-8233-bb1bcd828d6e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:14.674386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6140e5-1531-4873-9288-da843771f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:14.674985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6140e5-1531-4873-9288-da843771f050 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.675262 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6140e5-1531-4873-9288-da843771f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.675529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6140e5-1531-4873-9288-da843771f050 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.676193 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6140e5-1531-4873-9288-da843771f050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:14.678279 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6140e5-1531-4873-9288-da843771f050 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:14.800259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1220/2459] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:14 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:14.804145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6140e5-1531-4873-9288-da843771f050 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:14.809452 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845556f2bf394dfe89bddf4be51b2336', 'request_id': 'req-6d415c97-2f9d-4daf-8e6f-8443fe08f095'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:14.821592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6140e5-1531-4873-9288-da843771f050 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:14.822146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845556f2bf394dfe89bddf4be51b2336', 'request_id': 'req-6d415c97-2f9d-4daf-8e6f-8443fe08f095'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:14.834084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845556f2bf394dfe89bddf4be51b2336', 'request_id': 'req-6d415c97-2f9d-4daf-8e6f-8443fe08f095'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:14.916850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5ed62-5de9-4b76-bce1-784b9dddc366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:14.917592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ed62-5de9-4b76-bce1-784b9dddc366 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.918012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ed62-5de9-4b76-bce1-784b9dddc366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.918285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ed62-5de9-4b76-bce1-784b9dddc366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.923124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5ed62-5de9-4b76-bce1-784b9dddc366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:14.926618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5ed62-5de9-4b76-bce1-784b9dddc366 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:14.926878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] The token cache is being invalidate because project 845556f2bf394dfe89bddf4be51b2336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:14.927191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:14.927887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6d415c97-2f9d-4daf-8e6f-8443fe08f095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:14.929902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1240/2460] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:14 2022] DELETE /identity/v3/projects/845556f2bf394dfe89bddf4be51b2336 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:14.938179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8199375-f171-4294-984b-839736383d4c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.938179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8199375-f171-4294-984b-839736383d4c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.938179 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8199375-f171-4294-984b-839736383d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.952338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1221/2461] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:14.956460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5ed62-5de9-4b76-bce1-784b9dddc366 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:14.959256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-28a5ed62-5de9-4b76-bce1-784b9dddc366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:14.961206 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d8199375-f171-4294-984b-839736383d4c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:14.962523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d8199375-f171-4294-984b-839736383d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:14.971448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1241/2462] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:14.973129 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5ed62-5de9-4b76-bce1-784b9dddc366 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:14.978160 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbab498-d2fa-4d76-bb61-bb0cf500dd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:14.978821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbab498-d2fa-4d76-bb61-bb0cf500dd1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.979099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbab498-d2fa-4d76-bb61-bb0cf500dd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.979370 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbab498-d2fa-4d76-bb61-bb0cf500dd1c admin admin] PATH_INFO: `/v3/projects/5ac7dbc7105947aea9ccfe1311019fe6/users/e7848fe14b22499cbd22821affca79b9/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.979659 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee609e4f-07ca-427a-8ecd-b9cde6bbcc1c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:14.980010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee609e4f-07ca-427a-8ecd-b9cde6bbcc1c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:14.980530 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee609e4f-07ca-427a-8ecd-b9cde6bbcc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:14.981738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:14.997307 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbab498-d2fa-4d76-bb61-bb0cf500dd1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac7dbc7105947aea9ccfe1311019fe6, user_id=e7848fe14b22499cbd22821affca79b9, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:15.000714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbab498-d2fa-4d76-bb61-bb0cf500dd1c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:15.002741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ee609e4f-07ca-427a-8ecd-b9cde6bbcc1c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:15.004021 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ee609e4f-07ca-427a-8ecd-b9cde6bbcc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:15.012141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1242/2463] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:15.016837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee609e4f-07ca-427a-8ecd-b9cde6bbcc1c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:15.029802 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee609e4f-07ca-427a-8ecd-b9cde6bbcc1c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:15.035068 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896cd76-24fb-497c-b0fd-628cd54e2dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:15.035843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896cd76-24fb-497c-b0fd-628cd54e2dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.036143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896cd76-24fb-497c-b0fd-628cd54e2dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.041728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896cd76-24fb-497c-b0fd-628cd54e2dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.041728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896cd76-24fb-497c-b0fd-628cd54e2dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:15.041728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896cd76-24fb-497c-b0fd-628cd54e2dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:15.041728 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896cd76-24fb-497c-b0fd-628cd54e2dbe admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:15.053016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1243/2464] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:30:15.057459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896cd76-24fb-497c-b0fd-628cd54e2dbe admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:15.065638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1222/2465] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:14 2022] PUT /identity/v3/projects/5ac7dbc7105947aea9ccfe1311019fe6/users/e7848fe14b22499cbd22821affca79b9/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:15.068788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896cd76-24fb-497c-b0fd-628cd54e2dbe admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:15.069229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbab498-d2fa-4d76-bb61-bb0cf500dd1c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:15.073594 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:15.129239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7e7cb-c519-41dd-8869-e3ac7c6c78b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:15.130025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e7cb-c519-41dd-8869-e3ac7c6c78b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.130309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e7cb-c519-41dd-8869-e3ac7c6c78b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.130582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e7cb-c519-41dd-8869-e3ac7c6c78b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.131341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7e7cb-c519-41dd-8869-e3ac7c6c78b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:15.133501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7e7cb-c519-41dd-8869-e3ac7c6c78b2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:15.137831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbab498-d2fa-4d76-bb61-bb0cf500dd1c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:15.144156 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7454b45-4e24-49a0-928c-839407b60c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:15.145133 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454b45-4e24-49a0-928c-839407b60c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.145615 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454b45-4e24-49a0-928c-839407b60c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.146045 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454b45-4e24-49a0-928c-839407b60c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.147482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7454b45-4e24-49a0-928c-839407b60c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:15.148621 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7454b45-4e24-49a0-928c-839407b60c0a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:15.160779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1223/2466] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:15.164800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7454b45-4e24-49a0-928c-839407b60c0a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:15.174557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7454b45-4e24-49a0-928c-839407b60c0a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:15.179197 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3f3a4-b7b6-42db-aa6a-932b6233ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:15.179840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3f3a4-b7b6-42db-aa6a-932b6233ff40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.180118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3f3a4-b7b6-42db-aa6a-932b6233ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.180385 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3f3a4-b7b6-42db-aa6a-932b6233ff40 admin admin] PATH_INFO: `/v3/projects/5ac7dbc7105947aea9ccfe1311019fe6/users/e7848fe14b22499cbd22821affca79b9/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.182327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3f3a4-b7b6-42db-aa6a-932b6233ff40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac7dbc7105947aea9ccfe1311019fe6, user_id=e7848fe14b22499cbd22821affca79b9, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:15.187618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3f3a4-b7b6-42db-aa6a-932b6233ff40 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:15.195053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1224/2467] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:15 2022] PUT /identity/v3/projects/5ac7dbc7105947aea9ccfe1311019fe6/users/e7848fe14b22499cbd22821affca79b9/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:15.205853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78b28-cdba-45d6-9458-888b7bd6d2b8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.206141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78b28-cdba-45d6-9458-888b7bd6d2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.206412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d78b28-cdba-45d6-9458-888b7bd6d2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.234547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f4d78b28-cdba-45d6-9458-888b7bd6d2b8 None None] MFA Rules not processed for user `e7848fe14b22499cbd22821affca79b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:15.236093 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f4d78b28-cdba-45d6-9458-888b7bd6d2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:15.269355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1244/2468] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:15 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:15.270198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7e7cb-c519-41dd-8869-e3ac7c6c78b2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:15.316316 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1225/2469] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:15.328279 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d78b28-cdba-45d6-9458-888b7bd6d2b8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:15.330611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f4d78b28-cdba-45d6-9458-888b7bd6d2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:15.337880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7e7cb-c519-41dd-8869-e3ac7c6c78b2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:15.359198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5ff33-df03-41c3-a482-36b54f6b82af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:15.359198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5ff33-df03-41c3-a482-36b54f6b82af admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.359198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5ff33-df03-41c3-a482-36b54f6b82af admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.359198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5ff33-df03-41c3-a482-36b54f6b82af admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.359645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5ff33-df03-41c3-a482-36b54f6b82af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:15.359645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5ff33-df03-41c3-a482-36b54f6b82af admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:15.396934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d78b28-cdba-45d6-9458-888b7bd6d2b8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:15.402954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:15.430525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1245/2470] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:15 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:15.436151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5ff33-df03-41c3-a482-36b54f6b82af admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:15.447343 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5ff33-df03-41c3-a482-36b54f6b82af admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:15.453523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44536a82-ef97-4d1b-98c6-c19a5863c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:15.454213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44536a82-ef97-4d1b-98c6-c19a5863c8af admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.454486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44536a82-ef97-4d1b-98c6-c19a5863c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.454751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44536a82-ef97-4d1b-98c6-c19a5863c8af admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.454874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69300ad-924c-4017-9639-3e106da08d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:15.455555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44536a82-ef97-4d1b-98c6-c19a5863c8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:15.455668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69300ad-924c-4017-9639-3e106da08d1d service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.456092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69300ad-924c-4017-9639-3e106da08d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.456476 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69300ad-924c-4017-9639-3e106da08d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.457152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44536a82-ef97-4d1b-98c6-c19a5863c8af admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:15.468567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1246/2471] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:15.472528 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44536a82-ef97-4d1b-98c6-c19a5863c8af admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:15.483358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44536a82-ef97-4d1b-98c6-c19a5863c8af admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:15.489868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3a52-1e6f-4e45-832b-3e51d3cd6e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:15.490551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3a52-1e6f-4e45-832b-3e51d3cd6e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.490890 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3a52-1e6f-4e45-832b-3e51d3cd6e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.491224 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3a52-1e6f-4e45-832b-3e51d3cd6e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.492009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee3a52-1e6f-4e45-832b-3e51d3cd6e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:15.494243 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee3a52-1e6f-4e45-832b-3e51d3cd6e2c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:15.507585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1247/2472] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:15.511804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3a52-1e6f-4e45-832b-3e51d3cd6e2c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:15.522322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3a52-1e6f-4e45-832b-3e51d3cd6e2c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:15.524560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69300ad-924c-4017-9639-3e106da08d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:15.526139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69300ad-924c-4017-9639-3e106da08d1d service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:15.527183 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075d81f-bb80-4986-9acb-4c41355ecf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:15.527808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075d81f-bb80-4986-9acb-4c41355ecf0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.528090 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075d81f-bb80-4986-9acb-4c41355ecf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.528333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075d81f-bb80-4986-9acb-4c41355ecf0b admin admin] PATH_INFO: `/v3/projects/db0c733200dc4694a98d1a9b7a4f190e/users/2d5cde0774eb4941a69f40d0eca66c4c/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.540988 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1226/2473] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:15.548299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075d81f-bb80-4986-9acb-4c41355ecf0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0c733200dc4694a98d1a9b7a4f190e, user_id=2d5cde0774eb4941a69f40d0eca66c4c, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:15.553873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075d81f-bb80-4986-9acb-4c41355ecf0b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:15.631589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1248/2474] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:15 2022] PUT /identity/v3/projects/db0c733200dc4694a98d1a9b7a4f190e/users/2d5cde0774eb4941a69f40d0eca66c4c/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:15.644185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ee58b-99d1-4454-b4da-e714daa67564 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.644472 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ee58b-99d1-4454-b4da-e714daa67564 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.644738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ee58b-99d1-4454-b4da-e714daa67564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.690764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-127ee58b-99d1-4454-b4da-e714daa67564 None None] MFA Rules not processed for user `2d5cde0774eb4941a69f40d0eca66c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:15.692191 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-127ee58b-99d1-4454-b4da-e714daa67564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:15.764566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1227/2475] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:15.780634 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075d81f-bb80-4986-9acb-4c41355ecf0b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:15.827790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:15.843485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075d81f-bb80-4986-9acb-4c41355ecf0b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:15.847255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f582ce-232d-427a-85af-013f44b011a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:15.847856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f582ce-232d-427a-85af-013f44b011a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:15.848132 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f582ce-232d-427a-85af-013f44b011a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:15.848405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f582ce-232d-427a-85af-013f44b011a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:15.857833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f582ce-232d-427a-85af-013f44b011a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:15.859378 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f582ce-232d-427a-85af-013f44b011a7 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:15.869002 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1249/2476] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:18.698284 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ee58b-99d1-4454-b4da-e714daa67564 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:18.748891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:18.763745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ee58b-99d1-4454-b4da-e714daa67564 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:18.768676 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:18.769314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:18.769622 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:18.769894 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] PATH_INFO: `/v3/users/1b0bf44b6f324804901084248a11b3bb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:18.771037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0bf44b6f324804901084248a11b3bb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:18.772993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:18.922215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0bf44b6f324804901084248a11b3bb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:18.922895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0bf44b6f324804901084248a11b3bb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:18.929734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0bf44b6f324804901084248a11b3bb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:18.941327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0bf44b6f324804901084248a11b3bb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:19.063339 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0bf44b6f324804901084248a11b3bb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:19.064409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1228/2477] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:18 2022] DELETE /identity/v3/users/1b0bf44b6f324804901084248a11b3bb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:19.068899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a61c8-764f-41fb-be3d-9019a9c280e1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:19.069380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a61c8-764f-41fb-be3d-9019a9c280e1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:19.069482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a61c8-764f-41fb-be3d-9019a9c280e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:19.090809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cc5a61c8-764f-41fb-be3d-9019a9c280e1 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:19.092803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cc5a61c8-764f-41fb-be3d-9019a9c280e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:19.162684 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1250/2478] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:19.173619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:19.175225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:19.242463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b0335-8ab3-4a55-a4b2-db16da0b1079 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:19.246251 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ebb5c-5ac9-4d89-90be-07ec7648a899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:19.246979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ebb5c-5ac9-4d89-90be-07ec7648a899 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:19.247324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ebb5c-5ac9-4d89-90be-07ec7648a899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:19.248248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ebb5c-5ac9-4d89-90be-07ec7648a899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:19.258262 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ebb5c-5ac9-4d89-90be-07ec7648a899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:19.259779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ebb5c-5ac9-4d89-90be-07ec7648a899 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:19.270742 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1229/2479] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:19.799705 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a61c8-764f-41fb-be3d-9019a9c280e1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:19.801587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cc5a61c8-764f-41fb-be3d-9019a9c280e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:19.819046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a61c8-764f-41fb-be3d-9019a9c280e1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:19.837773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:19.838886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:19.839319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:19.839743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] PATH_INFO: `/v3/projects/5c7acb9e64ee47188ff39fd38ce4f518` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:19.841046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7acb9e64ee47188ff39fd38ce4f518)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:19.844081 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:20.020555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7acb9e64ee47188ff39fd38ce4f518', 'request_id': 'req-72a4602d-bbc5-4058-b045-838e1319020b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:20.026569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7acb9e64ee47188ff39fd38ce4f518', 'request_id': 'req-72a4602d-bbc5-4058-b045-838e1319020b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:20.034130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7acb9e64ee47188ff39fd38ce4f518', 'request_id': 'req-72a4602d-bbc5-4058-b045-838e1319020b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:20.140081 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] The token cache is being invalidate because project 5c7acb9e64ee47188ff39fd38ce4f518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:20.141202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:20.141908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:20.147807 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ebb5c-5ac9-4d89-90be-07ec7648a899 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:20.149051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1251/2480] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:19 2022] DELETE /identity/v3/projects/5c7acb9e64ee47188ff39fd38ce4f518 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:20.160207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ebb5c-5ac9-4d89-90be-07ec7648a899 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:20.243821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d9290-a34e-4426-8f58-903e929fe3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:20.244670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d9290-a34e-4426-8f58-903e929fe3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:20.245129 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d9290-a34e-4426-8f58-903e929fe3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:20.245733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d9290-a34e-4426-8f58-903e929fe3e9 admin admin] PATH_INFO: `/v3/users/e7848fe14b22499cbd22821affca79b9` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:20.248425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d9290-a34e-4426-8f58-903e929fe3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7848fe14b22499cbd22821affca79b9)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:20.252042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d9290-a34e-4426-8f58-903e929fe3e9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:20.271049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:20.464090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2c3d9290-a34e-4426-8f58-903e929fe3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7848fe14b22499cbd22821affca79b9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:20.464090 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2c3d9290-a34e-4426-8f58-903e929fe3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7848fe14b22499cbd22821affca79b9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:20.470496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2c3d9290-a34e-4426-8f58-903e929fe3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7848fe14b22499cbd22821affca79b9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:20.486487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2c3d9290-a34e-4426-8f58-903e929fe3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7848fe14b22499cbd22821affca79b9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:20.566770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2c3d9290-a34e-4426-8f58-903e929fe3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7848fe14b22499cbd22821affca79b9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:20.573286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1230/2481] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:20 2022] DELETE /identity/v3/users/e7848fe14b22499cbd22821affca79b9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:21.283829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:21.285303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:21.298509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4602d-bbc5-4058-b045-838e1319020b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:21.358910 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:21.359630 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:21.359973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:21.360307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] PATH_INFO: `/v3/projects/5ac7dbc7105947aea9ccfe1311019fe6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:21.361514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac7dbc7105947aea9ccfe1311019fe6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:21.363472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:21.370137 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:21.500054 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac7dbc7105947aea9ccfe1311019fe6', 'request_id': 'req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:21.507169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac7dbc7105947aea9ccfe1311019fe6', 'request_id': 'req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:21.514166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac7dbc7105947aea9ccfe1311019fe6', 'request_id': 'req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:21.636736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] The token cache is being invalidate because project 5ac7dbc7105947aea9ccfe1311019fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:21.636736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:21.636736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-109a9ddd-aecb-43f0-abb5-ed13becc6f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:21.637137 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1252/2482] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:21 2022] DELETE /identity/v3/projects/5ac7dbc7105947aea9ccfe1311019fe6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:21.642081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98692be6-be4e-4d8d-ae84-06a7fc4227c9 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:21.642778 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98692be6-be4e-4d8d-ae84-06a7fc4227c9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:21.643009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98692be6-be4e-4d8d-ae84-06a7fc4227c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:21.686335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-98692be6-be4e-4d8d-ae84-06a7fc4227c9 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:21.688836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-98692be6-be4e-4d8d-ae84-06a7fc4227c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:21.794170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1231/2483] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:21.802920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5d204-6d47-4918-baac-de5448012630 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:21.803273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5d204-6d47-4918-baac-de5448012630 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:21.803768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5d204-6d47-4918-baac-de5448012630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:21.831154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0cd5d204-6d47-4918-baac-de5448012630 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:21.832743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0cd5d204-6d47-4918-baac-de5448012630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:21.843387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1253/2484] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:21.847848 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98692be6-be4e-4d8d-ae84-06a7fc4227c9 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:21.861740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98692be6-be4e-4d8d-ae84-06a7fc4227c9 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:21.866535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431e3aa-017e-406d-bbf2-bda866eeb38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:21.867475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e3aa-017e-406d-bbf2-bda866eeb38c admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:21.867972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e3aa-017e-406d-bbf2-bda866eeb38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:21.868400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e3aa-017e-406d-bbf2-bda866eeb38c admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:21.869206 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431e3aa-017e-406d-bbf2-bda866eeb38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:21.869698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431e3aa-017e-406d-bbf2-bda866eeb38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:21.871486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431e3aa-017e-406d-bbf2-bda866eeb38c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:21.885428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1232/2485] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:21.895067 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5d204-6d47-4918-baac-de5448012630 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:21.901780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5d204-6d47-4918-baac-de5448012630 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:21.907145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8860df-a4d6-47d7-bfbb-3baae0d90875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:21.907804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8860df-a4d6-47d7-bfbb-3baae0d90875 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:21.908086 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8860df-a4d6-47d7-bfbb-3baae0d90875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:21.908359 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8860df-a4d6-47d7-bfbb-3baae0d90875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:21.908984 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8860df-a4d6-47d7-bfbb-3baae0d90875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:21.910937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8860df-a4d6-47d7-bfbb-3baae0d90875 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:22.002681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1254/2486] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:21 2022] POST /identity/v3/projects => generated 399 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:22.006933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431e3aa-017e-406d-bbf2-bda866eeb38c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:22.018508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431e3aa-017e-406d-bbf2-bda866eeb38c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:22.232920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e61c0-b921-4e0e-b5ae-9e3041a63a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:22.233576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e61c0-b921-4e0e-b5ae-9e3041a63a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:22.233855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e61c0-b921-4e0e-b5ae-9e3041a63a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:22.234119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e61c0-b921-4e0e-b5ae-9e3041a63a2d admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:22.234740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e61c0-b921-4e0e-b5ae-9e3041a63a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:22.236658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e61c0-b921-4e0e-b5ae-9e3041a63a2d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:22.349651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1233/2487] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:22 2022] POST /identity/v3/users => generated 300 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:22.353755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8860df-a4d6-47d7-bfbb-3baae0d90875 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:22.365167 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8860df-a4d6-47d7-bfbb-3baae0d90875 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:22.372967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371f242-0ce2-4192-b4b7-ca8001573b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:22.372967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371f242-0ce2-4192-b4b7-ca8001573b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:22.372967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371f242-0ce2-4192-b4b7-ca8001573b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:22.372967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371f242-0ce2-4192-b4b7-ca8001573b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:22.373659 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371f242-0ce2-4192-b4b7-ca8001573b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:22.374383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371f242-0ce2-4192-b4b7-ca8001573b2d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:22.384415 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1255/2488] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:22.389537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e61c0-b921-4e0e-b5ae-9e3041a63a2d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:22.396055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:22.399983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e61c0-b921-4e0e-b5ae-9e3041a63a2d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:22.404532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5316f-38a4-4bf2-9f11-3dde8e755df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:22.405118 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5316f-38a4-4bf2-9f11-3dde8e755df4 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:22.405423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5316f-38a4-4bf2-9f11-3dde8e755df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:22.405697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5316f-38a4-4bf2-9f11-3dde8e755df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:22.406334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5316f-38a4-4bf2-9f11-3dde8e755df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:22.407908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5316f-38a4-4bf2-9f11-3dde8e755df4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:22.417751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1234/2489] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:22.422906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371f242-0ce2-4192-b4b7-ca8001573b2d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:22.432928 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371f242-0ce2-4192-b4b7-ca8001573b2d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:22.437947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148902-4437-48f3-95e3-9ce9b4f26dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:22.438589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148902-4437-48f3-95e3-9ce9b4f26dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:22.438866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148902-4437-48f3-95e3-9ce9b4f26dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:22.439132 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148902-4437-48f3-95e3-9ce9b4f26dfc admin admin] PATH_INFO: `/v3/projects/ed1e7b77e1b342b8b506d59ed9d27744/users/549ac1c5c13346f68afc3d9f5c864e12/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:22.454271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc148902-4437-48f3-95e3-9ce9b4f26dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1e7b77e1b342b8b506d59ed9d27744, user_id=549ac1c5c13346f68afc3d9f5c864e12, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:22.456939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc148902-4437-48f3-95e3-9ce9b4f26dfc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:22.549658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1256/2490] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:22 2022] PUT /identity/v3/projects/ed1e7b77e1b342b8b506d59ed9d27744/users/549ac1c5c13346f68afc3d9f5c864e12/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:22.561561 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae52b3-560d-43f4-ab33-fd6c77c2290f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:22.561859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae52b3-560d-43f4-ab33-fd6c77c2290f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:22.562181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae52b3-560d-43f4-ab33-fd6c77c2290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:22.614286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-59ae52b3-560d-43f4-ab33-fd6c77c2290f None None] MFA Rules not processed for user `549ac1c5c13346f68afc3d9f5c864e12`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:22.615547 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-59ae52b3-560d-43f4-ab33-fd6c77c2290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:22.688447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1235/2491] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:22.692773 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148902-4437-48f3-95e3-9ce9b4f26dfc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:22.761231 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148902-4437-48f3-95e3-9ce9b4f26dfc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:22.766495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ee841-aa32-4a85-b51e-edc41bfb3333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:22.768865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee841-aa32-4a85-b51e-edc41bfb3333 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:22.768865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee841-aa32-4a85-b51e-edc41bfb3333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:22.768865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee841-aa32-4a85-b51e-edc41bfb3333 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:22.768865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ee841-aa32-4a85-b51e-edc41bfb3333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:22.770446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ee841-aa32-4a85-b51e-edc41bfb3333 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:22.855251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1257/2492] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:22 2022] POST /identity/v3/projects => generated 401 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:22.858967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae52b3-560d-43f4-ab33-fd6c77c2290f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:22.870425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae52b3-560d-43f4-ab33-fd6c77c2290f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:22.927977 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef604-1caf-43ad-b6fa-1d915f8e7314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:22.928575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef604-1caf-43ad-b6fa-1d915f8e7314 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:22.928890 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef604-1caf-43ad-b6fa-1d915f8e7314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:22.929170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebef604-1caf-43ad-b6fa-1d915f8e7314 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:22.929815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebef604-1caf-43ad-b6fa-1d915f8e7314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:22.931707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebef604-1caf-43ad-b6fa-1d915f8e7314 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:23.001192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1236/2493] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:22 2022] POST /identity/v3/users => generated 307 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:23.005194 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ee841-aa32-4a85-b51e-edc41bfb3333 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:23.016014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ee841-aa32-4a85-b51e-edc41bfb3333 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:23.021035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9879476-aecb-41e4-983f-0157a62f8fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:23.021786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9879476-aecb-41e4-983f-0157a62f8fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:23.022563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9879476-aecb-41e4-983f-0157a62f8fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:23.022563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9879476-aecb-41e4-983f-0157a62f8fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:23.022953 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9879476-aecb-41e4-983f-0157a62f8fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:23.024569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9879476-aecb-41e4-983f-0157a62f8fa7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:23.036617 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1258/2494] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:23.040945 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef604-1caf-43ad-b6fa-1d915f8e7314 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:23.051484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebef604-1caf-43ad-b6fa-1d915f8e7314 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:23.056075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e223945-031e-46dd-95fb-dce934761ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:23.056716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e223945-031e-46dd-95fb-dce934761ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:23.056994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e223945-031e-46dd-95fb-dce934761ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:23.057322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e223945-031e-46dd-95fb-dce934761ffd admin admin] PATH_INFO: `/v3/projects/fe3192b6e08240378b1b50df43505053/users/442d1ef83957443bbc43b392957e8ddd/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:23.074080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e223945-031e-46dd-95fb-dce934761ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3192b6e08240378b1b50df43505053, user_id=442d1ef83957443bbc43b392957e8ddd, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:23.078173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e223945-031e-46dd-95fb-dce934761ffd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:23.184233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1237/2495] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:23 2022] PUT /identity/v3/projects/fe3192b6e08240378b1b50df43505053/users/442d1ef83957443bbc43b392957e8ddd/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:23.188456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9879476-aecb-41e4-983f-0157a62f8fa7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:23.194909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:23.198697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9879476-aecb-41e4-983f-0157a62f8fa7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:23.254815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ccd43-63cc-4ef3-85f2-424d6a6d881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:23.255349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ccd43-63cc-4ef3-85f2-424d6a6d881c admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:23.255627 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ccd43-63cc-4ef3-85f2-424d6a6d881c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:23.255897 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ccd43-63cc-4ef3-85f2-424d6a6d881c admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:23.256596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ccd43-63cc-4ef3-85f2-424d6a6d881c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:23.258232 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ccd43-63cc-4ef3-85f2-424d6a6d881c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:23.268447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1259/2496] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:23.272520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e223945-031e-46dd-95fb-dce934761ffd admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:23.283525 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e223945-031e-46dd-95fb-dce934761ffd admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:23.288097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f861d-1034-4184-8f3e-9319ac132476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:23.288734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f861d-1034-4184-8f3e-9319ac132476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:23.289010 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f861d-1034-4184-8f3e-9319ac132476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:23.289278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f861d-1034-4184-8f3e-9319ac132476 admin admin] PATH_INFO: `/v3/projects/fe3192b6e08240378b1b50df43505053/users/442d1ef83957443bbc43b392957e8ddd/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:23.291195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f861d-1034-4184-8f3e-9319ac132476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3192b6e08240378b1b50df43505053, user_id=442d1ef83957443bbc43b392957e8ddd, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:23.293844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f861d-1034-4184-8f3e-9319ac132476 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:23.304111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1238/2497] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:23 2022] PUT /identity/v3/projects/fe3192b6e08240378b1b50df43505053/users/442d1ef83957443bbc43b392957e8ddd/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:23.315934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2128b-a5cb-4d1b-a543-6f4f7aa2e49c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:23.316365 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2128b-a5cb-4d1b-a543-6f4f7aa2e49c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:23.316639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2128b-a5cb-4d1b-a543-6f4f7aa2e49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:23.346255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-33a2128b-a5cb-4d1b-a543-6f4f7aa2e49c None None] MFA Rules not processed for user `442d1ef83957443bbc43b392957e8ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:23.347474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-33a2128b-a5cb-4d1b-a543-6f4f7aa2e49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:23.417268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1260/2498] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:23 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:23.428001 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f861d-1034-4184-8f3e-9319ac132476 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:23.429750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4b0f861d-1034-4184-8f3e-9319ac132476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:23.471401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:23.488540 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f861d-1034-4184-8f3e-9319ac132476 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:23.492520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cefb6-93a5-4e04-ab90-11eb4c2f0a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:23.493117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cefb6-93a5-4e04-ab90-11eb4c2f0a7d service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:23.493441 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cefb6-93a5-4e04-ab90-11eb4c2f0a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:23.493715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cefb6-93a5-4e04-ab90-11eb4c2f0a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:23.503376 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cefb6-93a5-4e04-ab90-11eb4c2f0a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:23.504800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cefb6-93a5-4e04-ab90-11eb4c2f0a7d service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:23.514900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1239/2499] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:23 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:23.852845 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2128b-a5cb-4d1b-a543-6f4f7aa2e49c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:23.863759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2128b-a5cb-4d1b-a543-6f4f7aa2e49c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:23.867660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9560bb1-ac79-467d-8f32-9328cf3faf5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:23.868418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9560bb1-ac79-467d-8f32-9328cf3faf5b service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:23.868635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9560bb1-ac79-467d-8f32-9328cf3faf5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:23.868799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9560bb1-ac79-467d-8f32-9328cf3faf5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:23.936170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9560bb1-ac79-467d-8f32-9328cf3faf5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:23.937944 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9560bb1-ac79-467d-8f32-9328cf3faf5b service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:23.946983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1261/2500] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:25.683821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cefb6-93a5-4e04-ab90-11eb4c2f0a7d service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:25.685379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ea4cefb6-93a5-4e04-ab90-11eb4c2f0a7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:25.755408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cefb6-93a5-4e04-ab90-11eb4c2f0a7d service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:25.759970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:25.760654 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:25.766083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:25.766083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] PATH_INFO: `/v3/users/2d5cde0774eb4941a69f40d0eca66c4c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:25.766083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5cde0774eb4941a69f40d0eca66c4c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:25.766083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:25.960259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9560bb1-ac79-467d-8f32-9328cf3faf5b service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:25.961682 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a9560bb1-ac79-467d-8f32-9328cf3faf5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:25.990061 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:26.019052 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9560bb1-ac79-467d-8f32-9328cf3faf5b service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:26.022810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e6ad3-8774-42a7-9a02-595fa20038d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:26.023401 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6ad3-8774-42a7-9a02-595fa20038d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:26.023670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6ad3-8774-42a7-9a02-595fa20038d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:26.023934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6ad3-8774-42a7-9a02-595fa20038d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:26.025734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bc5e6ad3-8774-42a7-9a02-595fa20038d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:26.038024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e6ad3-8774-42a7-9a02-595fa20038d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:26.039536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e6ad3-8774-42a7-9a02-595fa20038d0 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:26.049357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5cde0774eb4941a69f40d0eca66c4c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:26.050020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1262/2501] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:26.050514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5cde0774eb4941a69f40d0eca66c4c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:26.059932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5cde0774eb4941a69f40d0eca66c4c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:26.072669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5cde0774eb4941a69f40d0eca66c4c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:26.155553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5cde0774eb4941a69f40d0eca66c4c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:26.164023 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1240/2502] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:25 2022] DELETE /identity/v3/users/2d5cde0774eb4941a69f40d0eca66c4c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:26.168579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459f6a-b590-42eb-99b1-f70a0d21bbb3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:26.168854 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459f6a-b590-42eb-99b1-f70a0d21bbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:26.169122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c459f6a-b590-42eb-99b1-f70a0d21bbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:26.188919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3c459f6a-b590-42eb-99b1-f70a0d21bbb3 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:26.190152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3c459f6a-b590-42eb-99b1-f70a0d21bbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:26.247950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1263/2503] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:26.259139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:26.260763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:26.324735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dcd52-4c6f-444d-8285-08cd8c1abae2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:26.329009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add2409-0322-4b9f-97fe-6a0235889025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:26.329654 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add2409-0322-4b9f-97fe-6a0235889025 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:26.329934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add2409-0322-4b9f-97fe-6a0235889025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:26.330201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add2409-0322-4b9f-97fe-6a0235889025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:26.339401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add2409-0322-4b9f-97fe-6a0235889025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:26.340831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add2409-0322-4b9f-97fe-6a0235889025 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:26.349613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:26.352083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1241/2504] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:26.850398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c459f6a-b590-42eb-99b1-f70a0d21bbb3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:26.851862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3c459f6a-b590-42eb-99b1-f70a0d21bbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:26.866604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c459f6a-b590-42eb-99b1-f70a0d21bbb3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:26.872820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:26.873631 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:26.873974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:26.874310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] PATH_INFO: `/v3/projects/db0c733200dc4694a98d1a9b7a4f190e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:26.875735 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0c733200dc4694a98d1a9b7a4f190e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:26.878197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:27.007311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0c733200dc4694a98d1a9b7a4f190e', 'request_id': 'req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:27.014267 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0c733200dc4694a98d1a9b7a4f190e', 'request_id': 'req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:27.021701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0c733200dc4694a98d1a9b7a4f190e', 'request_id': 'req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:27.137588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] The token cache is being invalidate because project db0c733200dc4694a98d1a9b7a4f190e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:27.137978 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:27.139814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6ee51efe-dd0e-4a05-ac72-b7891cabeb0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:27.141334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1264/2505] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:26 2022] DELETE /identity/v3/projects/db0c733200dc4694a98d1a9b7a4f190e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:27.147663 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208eb0b-f702-40a6-9361-bc0177571ad2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:27.148148 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208eb0b-f702-40a6-9361-bc0177571ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:27.148244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208eb0b-f702-40a6-9361-bc0177571ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:27.167780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e208eb0b-f702-40a6-9361-bc0177571ad2 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:27.168919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e208eb0b-f702-40a6-9361-bc0177571ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:27.229190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1242/2506] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:27.237869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61988d5d-9fa3-4085-80e3-080bea9edf41 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:27.238507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61988d5d-9fa3-4085-80e3-080bea9edf41 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:27.238874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61988d5d-9fa3-4085-80e3-080bea9edf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:27.260770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-61988d5d-9fa3-4085-80e3-080bea9edf41 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:27.262024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-61988d5d-9fa3-4085-80e3-080bea9edf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:27.272134 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1265/2507] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:27.281763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208eb0b-f702-40a6-9361-bc0177571ad2 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:27.288237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208eb0b-f702-40a6-9361-bc0177571ad2 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:27.293123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13e955-72d2-42a7-bf22-756eecddc047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:27.294361 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13e955-72d2-42a7-bf22-756eecddc047 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:27.294827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13e955-72d2-42a7-bf22-756eecddc047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:27.296022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13e955-72d2-42a7-bf22-756eecddc047 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:27.297344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13e955-72d2-42a7-bf22-756eecddc047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:27.298537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13e955-72d2-42a7-bf22-756eecddc047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:27.302080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13e955-72d2-42a7-bf22-756eecddc047 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:27.317806 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1243/2508] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:27.323847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61988d5d-9fa3-4085-80e3-080bea9edf41 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:27.334807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61988d5d-9fa3-4085-80e3-080bea9edf41 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:27.343770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d88e4a-1cd8-462a-a5b6-a7cb19bbca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:27.348106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d88e4a-1cd8-462a-a5b6-a7cb19bbca84 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:27.348106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d88e4a-1cd8-462a-a5b6-a7cb19bbca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:27.348106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d88e4a-1cd8-462a-a5b6-a7cb19bbca84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:27.348106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d88e4a-1cd8-462a-a5b6-a7cb19bbca84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:27.348106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d88e4a-1cd8-462a-a5b6-a7cb19bbca84 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:27.464105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1266/2509] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:27 2022] POST /identity/v3/projects => generated 407 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:27.468497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13e955-72d2-42a7-bf22-756eecddc047 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:27.480124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13e955-72d2-42a7-bf22-756eecddc047 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:27.547527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b57065-a33f-4125-93fd-caca46717d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:27.548139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57065-a33f-4125-93fd-caca46717d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:27.553349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57065-a33f-4125-93fd-caca46717d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:27.553349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57065-a33f-4125-93fd-caca46717d87 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:27.553349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b57065-a33f-4125-93fd-caca46717d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:27.553349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b57065-a33f-4125-93fd-caca46717d87 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:27.641245 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1244/2510] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:27 2022] POST /identity/v3/users => generated 304 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:27.646467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d88e4a-1cd8-462a-a5b6-a7cb19bbca84 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:27.659745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d88e4a-1cd8-462a-a5b6-a7cb19bbca84 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:27.665887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c4ad4-cac0-4ac6-af3a-b549892a60cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:27.666790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c4ad4-cac0-4ac6-af3a-b549892a60cb admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:27.667277 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c4ad4-cac0-4ac6-af3a-b549892a60cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:27.676726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c4ad4-cac0-4ac6-af3a-b549892a60cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:27.676726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c4ad4-cac0-4ac6-af3a-b549892a60cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:27.676726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c4ad4-cac0-4ac6-af3a-b549892a60cb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:27.696105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1267/2511] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:27.700079 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b57065-a33f-4125-93fd-caca46717d87 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:27.711682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b57065-a33f-4125-93fd-caca46717d87 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:27.716644 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b171699-b4ca-4221-89e9-7a23e3d899a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:27.717388 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b171699-b4ca-4221-89e9-7a23e3d899a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:27.718057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b171699-b4ca-4221-89e9-7a23e3d899a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:27.718057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b171699-b4ca-4221-89e9-7a23e3d899a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:27.718762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b171699-b4ca-4221-89e9-7a23e3d899a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:27.720456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b171699-b4ca-4221-89e9-7a23e3d899a2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:27.732524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1245/2512] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:27.736962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c4ad4-cac0-4ac6-af3a-b549892a60cb admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:27.747265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c4ad4-cac0-4ac6-af3a-b549892a60cb admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:27.752900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919326c4-a858-401e-8c5c-2c2960c60697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:27.753629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919326c4-a858-401e-8c5c-2c2960c60697 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:27.753903 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919326c4-a858-401e-8c5c-2c2960c60697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:27.754182 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919326c4-a858-401e-8c5c-2c2960c60697 admin admin] PATH_INFO: `/v3/projects/33c12a4f16f34ff48ca0d632ba56aa0e/users/7fb4b69d229846ae8429ce9f38385091/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:27.762799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:27.770275 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919326c4-a858-401e-8c5c-2c2960c60697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c12a4f16f34ff48ca0d632ba56aa0e, user_id=7fb4b69d229846ae8429ce9f38385091, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:27.772914 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919326c4-a858-401e-8c5c-2c2960c60697 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:27.906860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1268/2513] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:27 2022] PUT /identity/v3/projects/33c12a4f16f34ff48ca0d632ba56aa0e/users/7fb4b69d229846ae8429ce9f38385091/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:27.919435 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768ce00-cd5e-4cfa-b9f1-e7de60aeff38 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:27.919958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768ce00-cd5e-4cfa-b9f1-e7de60aeff38 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:27.920838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768ce00-cd5e-4cfa-b9f1-e7de60aeff38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:27.969712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8768ce00-cd5e-4cfa-b9f1-e7de60aeff38 None None] MFA Rules not processed for user `7fb4b69d229846ae8429ce9f38385091`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:27.971242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8768ce00-cd5e-4cfa-b9f1-e7de60aeff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:28.047647 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:28.064692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1246/2514] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:27 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:28.065891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919326c4-a858-401e-8c5c-2c2960c60697 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:28.163169 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919326c4-a858-401e-8c5c-2c2960c60697 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:28.169988 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466aaff5-3088-4cb4-a16a-631ef43a94d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:28.172174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aaff5-3088-4cb4-a16a-631ef43a94d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:28.173350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aaff5-3088-4cb4-a16a-631ef43a94d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:28.173788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466aaff5-3088-4cb4-a16a-631ef43a94d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:28.174860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466aaff5-3088-4cb4-a16a-631ef43a94d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:28.177356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466aaff5-3088-4cb4-a16a-631ef43a94d1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:28.276948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1269/2515] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:28 2022] POST /identity/v3/projects => generated 407 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:28.278659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768ce00-cd5e-4cfa-b9f1-e7de60aeff38 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:28.300394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768ce00-cd5e-4cfa-b9f1-e7de60aeff38 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:28.377108 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435fe27-8998-409d-8d99-b11592c5978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:28.377926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435fe27-8998-409d-8d99-b11592c5978c admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:28.378286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435fe27-8998-409d-8d99-b11592c5978c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:28.378711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435fe27-8998-409d-8d99-b11592c5978c admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:28.379424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435fe27-8998-409d-8d99-b11592c5978c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:28.381608 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435fe27-8998-409d-8d99-b11592c5978c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:28.497048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1247/2516] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:28 2022] POST /identity/v3/users => generated 310 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:28.501525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466aaff5-3088-4cb4-a16a-631ef43a94d1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:28.511959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466aaff5-3088-4cb4-a16a-631ef43a94d1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:28.517603 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eed7d3-e0dc-4dcf-833d-9add6f84ec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:28.518308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eed7d3-e0dc-4dcf-833d-9add6f84ec80 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:28.518587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eed7d3-e0dc-4dcf-833d-9add6f84ec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:28.518860 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eed7d3-e0dc-4dcf-833d-9add6f84ec80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:28.519495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eed7d3-e0dc-4dcf-833d-9add6f84ec80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:28.521096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eed7d3-e0dc-4dcf-833d-9add6f84ec80 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:28.531659 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1270/2517] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:28.535825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435fe27-8998-409d-8d99-b11592c5978c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:28.546162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435fe27-8998-409d-8d99-b11592c5978c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:28.550846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b5247-50d1-4697-aa1a-0a1c85bae084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:28.551491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5247-50d1-4697-aa1a-0a1c85bae084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:28.551770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5247-50d1-4697-aa1a-0a1c85bae084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:28.552044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5247-50d1-4697-aa1a-0a1c85bae084 admin admin] PATH_INFO: `/v3/projects/c49aa66596784f5d8682fe088874aa90/users/313e603c32744f24852bc7b3bd6784c8/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:28.567321 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b5247-50d1-4697-aa1a-0a1c85bae084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49aa66596784f5d8682fe088874aa90, user_id=313e603c32744f24852bc7b3bd6784c8, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:28.569995 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b5247-50d1-4697-aa1a-0a1c85bae084 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:28.646968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1248/2518] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:28 2022] PUT /identity/v3/projects/c49aa66596784f5d8682fe088874aa90/users/313e603c32744f24852bc7b3bd6784c8/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:28.651073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eed7d3-e0dc-4dcf-833d-9add6f84ec80 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:28.663733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eed7d3-e0dc-4dcf-833d-9add6f84ec80 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:28.734107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cd0e0-f610-4009-9a08-c5b2204fdc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:28.734717 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd0e0-f610-4009-9a08-c5b2204fdc3d admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:28.734985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd0e0-f610-4009-9a08-c5b2204fdc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:28.735274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd0e0-f610-4009-9a08-c5b2204fdc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:28.735940 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cd0e0-f610-4009-9a08-c5b2204fdc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:28.737561 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cd0e0-f610-4009-9a08-c5b2204fdc3d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:28.759585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1271/2519] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:28.764370 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b5247-50d1-4697-aa1a-0a1c85bae084 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:28.793087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b5247-50d1-4697-aa1a-0a1c85bae084 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:28.798735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e11ac-fa47-46d3-a5cd-233b7b8621e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:28.799413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e11ac-fa47-46d3-a5cd-233b7b8621e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:28.799690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e11ac-fa47-46d3-a5cd-233b7b8621e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:28.799956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e11ac-fa47-46d3-a5cd-233b7b8621e7 admin admin] PATH_INFO: `/v3/projects/c49aa66596784f5d8682fe088874aa90/users/313e603c32744f24852bc7b3bd6784c8/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:28.801995 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e11ac-fa47-46d3-a5cd-233b7b8621e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49aa66596784f5d8682fe088874aa90, user_id=313e603c32744f24852bc7b3bd6784c8, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:28.804658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e11ac-fa47-46d3-a5cd-233b7b8621e7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:28.818765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1249/2520] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:28 2022] PUT /identity/v3/projects/c49aa66596784f5d8682fe088874aa90/users/313e603c32744f24852bc7b3bd6784c8/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:28.832477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76ae8a-009d-4c21-8fa5-2ad3995ea8a8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:28.832770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76ae8a-009d-4c21-8fa5-2ad3995ea8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:28.833046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76ae8a-009d-4c21-8fa5-2ad3995ea8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:28.869606 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ae76ae8a-009d-4c21-8fa5-2ad3995ea8a8 None None] MFA Rules not processed for user `313e603c32744f24852bc7b3bd6784c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:28.870964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ae76ae8a-009d-4c21-8fa5-2ad3995ea8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:28.925556 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:28.953483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1272/2521] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:28 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:28.960606 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e11ac-fa47-46d3-a5cd-233b7b8621e7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:28.962394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c70e11ac-fa47-46d3-a5cd-233b7b8621e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:29.031879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e11ac-fa47-46d3-a5cd-233b7b8621e7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:29.038100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9cdda-7fdf-4c0d-8ec5-a18e27fafb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:29.039217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9cdda-7fdf-4c0d-8ec5-a18e27fafb25 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:29.039217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9cdda-7fdf-4c0d-8ec5-a18e27fafb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:29.039440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9cdda-7fdf-4c0d-8ec5-a18e27fafb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:29.050152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9cdda-7fdf-4c0d-8ec5-a18e27fafb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:29.051735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9cdda-7fdf-4c0d-8ec5-a18e27fafb25 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:29.063761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1250/2522] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:28 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:29.523896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76ae8a-009d-4c21-8fa5-2ad3995ea8a8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:29.525353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ae76ae8a-009d-4c21-8fa5-2ad3995ea8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:29.605610 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76ae8a-009d-4c21-8fa5-2ad3995ea8a8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:29.617668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:29.618412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:29.618756 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:29.619097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] PATH_INFO: `/v3/users/549ac1c5c13346f68afc3d9f5c864e12` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:29.620579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549ac1c5c13346f68afc3d9f5c864e12)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:29.622790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:29.709115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9cdda-7fdf-4c0d-8ec5-a18e27fafb25 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:29.711162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e5e9cdda-7fdf-4c0d-8ec5-a18e27fafb25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:29.723218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9cdda-7fdf-4c0d-8ec5-a18e27fafb25 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:29.727859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4341605-7039-483d-a649-b7503ecf2773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:29.728592 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4341605-7039-483d-a649-b7503ecf2773 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:29.728939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4341605-7039-483d-a649-b7503ecf2773 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:29.729350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4341605-7039-483d-a649-b7503ecf2773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:29.789579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:29.800356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4341605-7039-483d-a649-b7503ecf2773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:29.802959 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4341605-7039-483d-a649-b7503ecf2773 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:29.813925 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1251/2523] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:29 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:29.887446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549ac1c5c13346f68afc3d9f5c864e12'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:29.901216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549ac1c5c13346f68afc3d9f5c864e12'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:29.948071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549ac1c5c13346f68afc3d9f5c864e12'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:29.973210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549ac1c5c13346f68afc3d9f5c864e12'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:29.973210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549ac1c5c13346f68afc3d9f5c864e12'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:30.041920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1273/2524] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:29 2022] DELETE /identity/v3/users/549ac1c5c13346f68afc3d9f5c864e12 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:30.046225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bda38-ecc9-44aa-b597-b88a053e24fa None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:30.046509 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bda38-ecc9-44aa-b597-b88a053e24fa None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:30.046780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bda38-ecc9-44aa-b597-b88a053e24fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:30.068059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-755bda38-ecc9-44aa-b597-b88a053e24fa None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:30.069274 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-755bda38-ecc9-44aa-b597-b88a053e24fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:30.100346 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:30.103671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:30.136078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1252/2525] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:30.146584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bda38-ecc9-44aa-b597-b88a053e24fa None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:30.148308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-755bda38-ecc9-44aa-b597-b88a053e24fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:30.181843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:30.186897 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b35c33-e935-4c99-aaee-638b4f8f01b0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:30.192129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30b2c-e98d-4b65-88ed-4123843b8792 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da5e1da2196b4ff399921809f40d3002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:30.192818 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30b2c-e98d-4b65-88ed-4123843b8792 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:30.193170 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30b2c-e98d-4b65-88ed-4123843b8792 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:30.193555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30b2c-e98d-4b65-88ed-4123843b8792 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:30.195284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-67f30b2c-e98d-4b65-88ed-4123843b8792 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:30.209495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f30b2c-e98d-4b65-88ed-4123843b8792 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:30.209902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f30b2c-e98d-4b65-88ed-4123843b8792 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:30.211642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bda38-ecc9-44aa-b597-b88a053e24fa None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:30.216194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c864c6a-af2c-4b64-9ea9-0eeff87c858c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:30.216800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c864c6a-af2c-4b64-9ea9-0eeff87c858c service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:30.218543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c864c6a-af2c-4b64-9ea9-0eeff87c858c service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:30.218821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c864c6a-af2c-4b64-9ea9-0eeff87c858c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:30.221180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1274/2526] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:30.228290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c864c6a-af2c-4b64-9ea9-0eeff87c858c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:30.229752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c864c6a-af2c-4b64-9ea9-0eeff87c858c service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:30.239755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1253/2527] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:30.296816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30b2c-e98d-4b65-88ed-4123843b8792 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:30.298715 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-67f30b2c-e98d-4b65-88ed-4123843b8792 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:30.316003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30b2c-e98d-4b65-88ed-4123843b8792 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:30.320689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:30.321323 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:30.321666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:30.321949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] PATH_INFO: `/v3/users/7b92f9048d654e4787d036f6adbd840b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:30.323074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b92f9048d654e4787d036f6adbd840b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:30.325191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:30.550758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b92f9048d654e4787d036f6adbd840b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:30.551447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b92f9048d654e4787d036f6adbd840b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:30.566552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b92f9048d654e4787d036f6adbd840b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:30.577606 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b92f9048d654e4787d036f6adbd840b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:30.577606 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b92f9048d654e4787d036f6adbd840b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:30.652926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1275/2528] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:30 2022] DELETE /identity/v3/users/7b92f9048d654e4787d036f6adbd840b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:30.708894 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c864c6a-af2c-4b64-9ea9-0eeff87c858c service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:30.711664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3c864c6a-af2c-4b64-9ea9-0eeff87c858c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:30.736968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c864c6a-af2c-4b64-9ea9-0eeff87c858c service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:30.814619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:30.815246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:30.815655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:30.815928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] PATH_INFO: `/v3/projects/ed1e7b77e1b342b8b506d59ed9d27744` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:30.817712 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1e7b77e1b342b8b506d59ed9d27744)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:30.819802 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:30.934112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:30.959469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1e7b77e1b342b8b506d59ed9d27744', 'request_id': 'req-b4cc0bea-1472-4477-b961-8956657e5fa6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:30.971674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1e7b77e1b342b8b506d59ed9d27744', 'request_id': 'req-b4cc0bea-1472-4477-b961-8956657e5fa6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:30.987707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:30.987707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:31.015392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989045c-e217-43a7-9cb6-1cbcde6f4c1f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:31.057699 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1e7b77e1b342b8b506d59ed9d27744', 'request_id': 'req-b4cc0bea-1472-4477-b961-8956657e5fa6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.071535 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] The token cache is being invalidate because project ed1e7b77e1b342b8b506d59ed9d27744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:31.071842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.072436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.075855 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1254/2529] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:30 2022] DELETE /identity/v3/projects/ed1e7b77e1b342b8b506d59ed9d27744 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:31.080116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:31.081784 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:31.091362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:31.092112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:31.093084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:31.093439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] PATH_INFO: `/v3/projects/9955166581814652b73ce7fbc377d025` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:31.094546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9955166581814652b73ce7fbc377d025)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:31.096510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:31.168098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc0bea-1472-4477-b961-8956657e5fa6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:31.174008 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:31.175223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:31.175223 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:31.177899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] PATH_INFO: `/v3/users/442d1ef83957443bbc43b392957e8ddd` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:31.177899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=442d1ef83957443bbc43b392957e8ddd)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:31.180061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:31.225202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9955166581814652b73ce7fbc377d025', 'request_id': 'req-c825a995-262b-4d44-a76f-5b474f22a77d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.232096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9955166581814652b73ce7fbc377d025', 'request_id': 'req-c825a995-262b-4d44-a76f-5b474f22a77d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.241513 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9955166581814652b73ce7fbc377d025', 'request_id': 'req-c825a995-262b-4d44-a76f-5b474f22a77d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.302095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] The token cache is being invalidate because project 9955166581814652b73ce7fbc377d025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:31.302095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.302095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c825a995-262b-4d44-a76f-5b474f22a77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.302651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1276/2530] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:30 2022] DELETE /identity/v3/projects/9955166581814652b73ce7fbc377d025 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:31.307529 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b93d8-4c88-4bd6-9eff-938873bc511c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:31.307814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b93d8-4c88-4bd6-9eff-938873bc511c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:31.308090 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b93d8-4c88-4bd6-9eff-938873bc511c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:31.331539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-085b93d8-4c88-4bd6-9eff-938873bc511c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:31.332803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-085b93d8-4c88-4bd6-9eff-938873bc511c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:31.372656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442d1ef83957443bbc43b392957e8ddd'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.373524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442d1ef83957443bbc43b392957e8ddd'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.384082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442d1ef83957443bbc43b392957e8ddd'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.398219 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442d1ef83957443bbc43b392957e8ddd'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.401210 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1277/2531] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:31.410896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85075e-8279-44a2-b36d-77589b6afd47 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:31.411185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85075e-8279-44a2-b36d-77589b6afd47 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:31.411458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85075e-8279-44a2-b36d-77589b6afd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:31.431361 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fb85075e-8279-44a2-b36d-77589b6afd47 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:31.432536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fb85075e-8279-44a2-b36d-77589b6afd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:31.442588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1278/2532] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:31.446964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85075e-8279-44a2-b36d-77589b6afd47 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:31.456360 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85075e-8279-44a2-b36d-77589b6afd47 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:31.461227 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd27ff-6bf8-4379-9957-99defd309365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:31.462024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd27ff-6bf8-4379-9957-99defd309365 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:31.462236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd27ff-6bf8-4379-9957-99defd309365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:31.462507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd27ff-6bf8-4379-9957-99defd309365 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:31.463147 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd27ff-6bf8-4379-9957-99defd309365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:31.463445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd27ff-6bf8-4379-9957-99defd309365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:31.465058 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd27ff-6bf8-4379-9957-99defd309365 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:31.478555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1279/2533] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:30:31.481658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442d1ef83957443bbc43b392957e8ddd'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.483968 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd27ff-6bf8-4379-9957-99defd309365 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:31.486461 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dcbd27ff-6bf8-4379-9957-99defd309365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:31.491335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1255/2534] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:31 2022] DELETE /identity/v3/users/442d1ef83957443bbc43b392957e8ddd => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:31.499405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd27ff-6bf8-4379-9957-99defd309365 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:31.501899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:31.506850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:31.568575 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11988598-97a4-4d2b-bc49-902e0d37eff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:31.569202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11988598-97a4-4d2b-bc49-902e0d37eff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:31.569527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11988598-97a4-4d2b-bc49-902e0d37eff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:31.569801 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11988598-97a4-4d2b-bc49-902e0d37eff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:31.577190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11988598-97a4-4d2b-bc49-902e0d37eff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:31.577190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11988598-97a4-4d2b-bc49-902e0d37eff0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:31.598413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bec8a2-cd07-45bd-8547-bab8bebdf930 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:31.605790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4961e90-4fdf-4654-8789-6f27882a04c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:31.605790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961e90-4fdf-4654-8789-6f27882a04c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:31.605790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961e90-4fdf-4654-8789-6f27882a04c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:31.605790 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961e90-4fdf-4654-8789-6f27882a04c0 admin admin] PATH_INFO: `/v3/users/d1dbdb3220194e6c8e99d165ab1775b9` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:31.606195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4961e90-4fdf-4654-8789-6f27882a04c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1dbdb3220194e6c8e99d165ab1775b9)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:31.608200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4961e90-4fdf-4654-8789-6f27882a04c0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:31.730400 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1280/2535] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:31 2022] POST /identity/v3/projects => generated 389 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:31.735407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11988598-97a4-4d2b-bc49-902e0d37eff0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:31.746550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:31.812454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11988598-97a4-4d2b-bc49-902e0d37eff0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:31.817510 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c04ac-9db9-4463-b18e-4438d04061ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:31.818129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c04ac-9db9-4463-b18e-4438d04061ff admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:31.818408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c04ac-9db9-4463-b18e-4438d04061ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:31.818675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c04ac-9db9-4463-b18e-4438d04061ff admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:31.819299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c04ac-9db9-4463-b18e-4438d04061ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:31.821344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c04ac-9db9-4463-b18e-4438d04061ff admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:31.890398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:31.895114 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d4961e90-4fdf-4654-8789-6f27882a04c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1dbdb3220194e6c8e99d165ab1775b9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.897854 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d4961e90-4fdf-4654-8789-6f27882a04c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1dbdb3220194e6c8e99d165ab1775b9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.910940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d4961e90-4fdf-4654-8789-6f27882a04c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1dbdb3220194e6c8e99d165ab1775b9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.923541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d4961e90-4fdf-4654-8789-6f27882a04c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1dbdb3220194e6c8e99d165ab1775b9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:31.944188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1281/2536] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:31 2022] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:31.948356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c04ac-9db9-4463-b18e-4438d04061ff admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:31.958594 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c04ac-9db9-4463-b18e-4438d04061ff admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:31.963419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceca9d-add1-4475-93f8-164ccac2d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:31.964165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceca9d-add1-4475-93f8-164ccac2d228 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:31.964442 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceca9d-add1-4475-93f8-164ccac2d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:31.964808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceca9d-add1-4475-93f8-164ccac2d228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:31.965582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ceca9d-add1-4475-93f8-164ccac2d228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:31.967873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ceca9d-add1-4475-93f8-164ccac2d228 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:31.978766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1282/2537] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:31.986017 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceca9d-add1-4475-93f8-164ccac2d228 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:31.994788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d4961e90-4fdf-4654-8789-6f27882a04c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1dbdb3220194e6c8e99d165ab1775b9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:32.005100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1256/2538] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:31 2022] DELETE /identity/v3/users/d1dbdb3220194e6c8e99d165ab1775b9 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:32.006680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceca9d-add1-4475-93f8-164ccac2d228 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:32.008627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93e115-e88d-4b57-904e-bbefaa0bce4f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.009009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93e115-e88d-4b57-904e-bbefaa0bce4f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.009482 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93e115-e88d-4b57-904e-bbefaa0bce4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.037497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-de93e115-e88d-4b57-904e-bbefaa0bce4f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:32.039160 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-de93e115-e88d-4b57-904e-bbefaa0bce4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:32.077140 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bc866-0eab-48d9-860a-8295ce72b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:32.077974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bc866-0eab-48d9-860a-8295ce72b3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.078552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bc866-0eab-48d9-860a-8295ce72b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.078885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bc866-0eab-48d9-860a-8295ce72b3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.079626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bc866-0eab-48d9-860a-8295ce72b3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:32.082166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bc866-0eab-48d9-860a-8295ce72b3d0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:32.101449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1283/2539] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:32.101449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bc866-0eab-48d9-860a-8295ce72b3d0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:32.101449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-116bc866-0eab-48d9-860a-8295ce72b3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:32.115901 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bc866-0eab-48d9-860a-8295ce72b3d0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:32.125522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1257/2540] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:32.125522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93e115-e88d-4b57-904e-bbefaa0bce4f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:32.125522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-de93e115-e88d-4b57-904e-bbefaa0bce4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:32.125964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:32.125964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.125964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.125964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] PATH_INFO: `/v3/projects/fe3192b6e08240378b1b50df43505053` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.126352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3192b6e08240378b1b50df43505053)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:32.126463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:32.132828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93e115-e88d-4b57-904e-bbefaa0bce4f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:32.138195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56451110-f9c6-4eda-8835-7c0d88309079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:32.139189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56451110-f9c6-4eda-8835-7c0d88309079 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.139538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56451110-f9c6-4eda-8835-7c0d88309079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.139870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56451110-f9c6-4eda-8835-7c0d88309079 admin admin] PATH_INFO: `/v3/projects/08769ad7c59d4946b791d20de1ec4dd0/users/df81ba6aae204b37b548b6786e958298/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.158246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56451110-f9c6-4eda-8835-7c0d88309079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08769ad7c59d4946b791d20de1ec4dd0, user_id=df81ba6aae204b37b548b6786e958298, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:32.161696 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56451110-f9c6-4eda-8835-7c0d88309079 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:32.287470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1258/2541] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:32 2022] PUT /identity/v3/projects/08769ad7c59d4946b791d20de1ec4dd0/users/df81ba6aae204b37b548b6786e958298/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:32.288662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56451110-f9c6-4eda-8835-7c0d88309079 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:32.290493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-56451110-f9c6-4eda-8835-7c0d88309079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:32.297295 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3192b6e08240378b1b50df43505053', 'request_id': 'req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:32.303479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3192b6e08240378b1b50df43505053', 'request_id': 'req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:32.315333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3192b6e08240378b1b50df43505053', 'request_id': 'req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:32.360704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56451110-f9c6-4eda-8835-7c0d88309079 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:32.410757 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519778a-1772-47a9-a455-a1090018e645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:32.411366 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519778a-1772-47a9-a455-a1090018e645 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.411654 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519778a-1772-47a9-a455-a1090018e645 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.411919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519778a-1772-47a9-a455-a1090018e645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.424108 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] The token cache is being invalidate because project fe3192b6e08240378b1b50df43505053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:32.427827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:32.427827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-19a6fdd1-eed9-4e00-b28c-192c4ebacdad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:32.427827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1284/2542] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:32 2022] DELETE /identity/v3/projects/fe3192b6e08240378b1b50df43505053 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:32.428135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b206ee-5d87-424c-a983-e977e017c834 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.428282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b206ee-5d87-424c-a983-e977e017c834 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.428513 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b206ee-5d87-424c-a983-e977e017c834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.462009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-57b206ee-5d87-424c-a983-e977e017c834 None None] MFA Rules not processed for user `df81ba6aae204b37b548b6786e958298`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:32.463379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-57b206ee-5d87-424c-a983-e977e017c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:32.481576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519778a-1772-47a9-a455-a1090018e645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:32.484057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519778a-1772-47a9-a455-a1090018e645 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:32.494579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1259/2543] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:32.497513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6a1d-237d-4351-accc-fdc5a44fe414 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.497513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6a1d-237d-4351-accc-fdc5a44fe414 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.497513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6a1d-237d-4351-accc-fdc5a44fe414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.521208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-861d6a1d-237d-4351-accc-fdc5a44fe414 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:32.522678 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-861d6a1d-237d-4351-accc-fdc5a44fe414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:32.532426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1260/2544] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:32.540486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1285/2545] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:32.544811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3c333-daaa-45e6-a183-9fd32ba9a007 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.544811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3c333-daaa-45e6-a183-9fd32ba9a007 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.544811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3c333-daaa-45e6-a183-9fd32ba9a007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.547861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b206ee-5d87-424c-a983-e977e017c834 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:32.549470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-57b206ee-5d87-424c-a983-e977e017c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:32.564270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-33a3c333-daaa-45e6-a183-9fd32ba9a007 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:32.567870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-33a3c333-daaa-45e6-a183-9fd32ba9a007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:32.567986 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b206ee-5d87-424c-a983-e977e017c834 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:32.572462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ac94c-629b-4ad8-bbbf-d845d82997f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:32.573122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ac94c-629b-4ad8-bbbf-d845d82997f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.573533 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ac94c-629b-4ad8-bbbf-d845d82997f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.573768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ac94c-629b-4ad8-bbbf-d845d82997f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.574835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ac94c-629b-4ad8-bbbf-d845d82997f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:32.576690 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ac94c-629b-4ad8-bbbf-d845d82997f1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:32.578862 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1261/2546] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:32.579775 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3c333-daaa-45e6-a183-9fd32ba9a007 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:32.592103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3c333-daaa-45e6-a183-9fd32ba9a007 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:32.599041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25aa6f-77f0-4b47-808e-4c4c0b33fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:32.600042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25aa6f-77f0-4b47-808e-4c4c0b33fca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.600501 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25aa6f-77f0-4b47-808e-4c4c0b33fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.600924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25aa6f-77f0-4b47-808e-4c4c0b33fca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.601833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25aa6f-77f0-4b47-808e-4c4c0b33fca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:32.602296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25aa6f-77f0-4b47-808e-4c4c0b33fca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:32.603905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25aa6f-77f0-4b47-808e-4c4c0b33fca5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:32.617880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1262/2547] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:32.622414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25aa6f-77f0-4b47-808e-4c4c0b33fca5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:32.633668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25aa6f-77f0-4b47-808e-4c4c0b33fca5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:32.639081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b3863-a321-4c1c-8959-8d177fb48270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:32.639690 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b3863-a321-4c1c-8959-8d177fb48270 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.639966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b3863-a321-4c1c-8959-8d177fb48270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.640234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b3863-a321-4c1c-8959-8d177fb48270 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.640917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b3863-a321-4c1c-8959-8d177fb48270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:32.643219 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b3863-a321-4c1c-8959-8d177fb48270 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:32.699330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1286/2548] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:32 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:32.704009 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ac94c-629b-4ad8-bbbf-d845d82997f1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:32.769869 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ac94c-629b-4ad8-bbbf-d845d82997f1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:32.775391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102678c6-0b97-459f-9ef5-d9ab1a7d2e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:32.776077 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102678c6-0b97-459f-9ef5-d9ab1a7d2e80 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.776358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102678c6-0b97-459f-9ef5-d9ab1a7d2e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.776691 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102678c6-0b97-459f-9ef5-d9ab1a7d2e80 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.777338 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102678c6-0b97-459f-9ef5-d9ab1a7d2e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:32.780408 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102678c6-0b97-459f-9ef5-d9ab1a7d2e80 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:32.811280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1263/2549] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:32 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:32.815439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b3863-a321-4c1c-8959-8d177fb48270 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:32.894185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b3863-a321-4c1c-8959-8d177fb48270 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:32.904985 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5234229-5090-467a-8d62-aa75a65e6779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:32.905919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5234229-5090-467a-8d62-aa75a65e6779 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.906850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5234229-5090-467a-8d62-aa75a65e6779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.906983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5234229-5090-467a-8d62-aa75a65e6779 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.917494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1287/2550] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:32 2022] POST /identity/v3/users => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:32.917682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5234229-5090-467a-8d62-aa75a65e6779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:32.917682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5234229-5090-467a-8d62-aa75a65e6779 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:32.921014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102678c6-0b97-459f-9ef5-d9ab1a7d2e80 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:32.931110 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102678c6-0b97-459f-9ef5-d9ab1a7d2e80 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:32.938548 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e745794-ea87-4e68-965a-3dde36c2c185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:32.939166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e745794-ea87-4e68-965a-3dde36c2c185 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.939444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e745794-ea87-4e68-965a-3dde36c2c185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.939715 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e745794-ea87-4e68-965a-3dde36c2c185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.940451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e745794-ea87-4e68-965a-3dde36c2c185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:32.942135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e745794-ea87-4e68-965a-3dde36c2c185 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:32.952540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1288/2551] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:32.956745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e745794-ea87-4e68-965a-3dde36c2c185 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:32.967252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e745794-ea87-4e68-965a-3dde36c2c185 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:32.988120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3dc9e-9038-414c-9819-af3c55b22d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:32.988120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3dc9e-9038-414c-9819-af3c55b22d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:32.988120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3dc9e-9038-414c-9819-af3c55b22d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:32.988120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3dc9e-9038-414c-9819-af3c55b22d02 admin admin] PATH_INFO: `/v3/projects/e14c8701e1ad4a35a4c930cdb7bd1eda/users/fb2ffed955b1434ca968b814f148829c/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:32.988527 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3dc9e-9038-414c-9819-af3c55b22d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14c8701e1ad4a35a4c930cdb7bd1eda, user_id=fb2ffed955b1434ca968b814f148829c, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:32.991085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3dc9e-9038-414c-9819-af3c55b22d02 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:33.086650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:33.092944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1264/2552] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:32 2022] POST /identity/v3/users => generated 292 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:33.095071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5234229-5090-467a-8d62-aa75a65e6779 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:33.095473 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f5234229-5090-467a-8d62-aa75a65e6779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:33.109278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5234229-5090-467a-8d62-aa75a65e6779 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:33.114365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:33.115146 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:33.115361 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:33.115634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] PATH_INFO: `/v3/projects/8b7818e68fd9440c80ea4de646a839b7` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:33.116929 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7818e68fd9440c80ea4de646a839b7)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:33.118872 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:33.124929 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1289/2553] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:32 2022] PUT /identity/v3/projects/e14c8701e1ad4a35a4c930cdb7bd1eda/users/fb2ffed955b1434ca968b814f148829c/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:33.125740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3dc9e-9038-414c-9819-af3c55b22d02 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:33.194609 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:33.197987 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3dc9e-9038-414c-9819-af3c55b22d02 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:33.203432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623f24d-aa3d-4e42-9e7f-cdd45271d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:33.204039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623f24d-aa3d-4e42-9e7f-cdd45271d551 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:33.204310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623f24d-aa3d-4e42-9e7f-cdd45271d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:33.204579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623f24d-aa3d-4e42-9e7f-cdd45271d551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:33.205234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623f24d-aa3d-4e42-9e7f-cdd45271d551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:33.206902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623f24d-aa3d-4e42-9e7f-cdd45271d551 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:33.218573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1290/2554] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:33.219395 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623f24d-aa3d-4e42-9e7f-cdd45271d551 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:33.229180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623f24d-aa3d-4e42-9e7f-cdd45271d551 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:33.234551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727e3a-7c19-45ff-82a5-43ef6acf6c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:33.235150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727e3a-7c19-45ff-82a5-43ef6acf6c9c admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:33.235423 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727e3a-7c19-45ff-82a5-43ef6acf6c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:33.235693 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727e3a-7c19-45ff-82a5-43ef6acf6c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:33.236323 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68727e3a-7c19-45ff-82a5-43ef6acf6c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:33.238034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68727e3a-7c19-45ff-82a5-43ef6acf6c9c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:33.249035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1291/2555] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:33.250084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727e3a-7c19-45ff-82a5-43ef6acf6c9c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:33.254349 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7818e68fd9440c80ea4de646a839b7', 'request_id': 'req-34e784b7-db8f-4da1-8dba-03b9366ec896'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:33.260390 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727e3a-7c19-45ff-82a5-43ef6acf6c9c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:33.261181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7818e68fd9440c80ea4de646a839b7', 'request_id': 'req-34e784b7-db8f-4da1-8dba-03b9366ec896'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:33.333753 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb010ed9-1bca-40e0-8917-5590370cc125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:33.334370 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb010ed9-1bca-40e0-8917-5590370cc125 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:33.334691 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb010ed9-1bca-40e0-8917-5590370cc125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:33.334977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb010ed9-1bca-40e0-8917-5590370cc125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:33.335930 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb010ed9-1bca-40e0-8917-5590370cc125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:33.337278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb010ed9-1bca-40e0-8917-5590370cc125 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:33.338587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7818e68fd9440c80ea4de646a839b7', 'request_id': 'req-34e784b7-db8f-4da1-8dba-03b9366ec896'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:33.349158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1292/2556] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:33.350151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb010ed9-1bca-40e0-8917-5590370cc125 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:33.357167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] The token cache is being invalidate because project 8b7818e68fd9440c80ea4de646a839b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:33.358071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:33.361409 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb010ed9-1bca-40e0-8917-5590370cc125 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:33.361716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:33.363270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1265/2557] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:33 2022] DELETE /identity/v3/projects/8b7818e68fd9440c80ea4de646a839b7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:33.364100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:33.365522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:33.367856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24f91d-56af-4d8f-9f2c-5da7e74bf995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:33.368941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24f91d-56af-4d8f-9f2c-5da7e74bf995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:33.369310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24f91d-56af-4d8f-9f2c-5da7e74bf995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:33.369636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24f91d-56af-4d8f-9f2c-5da7e74bf995 admin admin] PATH_INFO: `/v3/projects/e14c8701e1ad4a35a4c930cdb7bd1eda/users/fb2ffed955b1434ca968b814f148829c/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:33.372082 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24f91d-56af-4d8f-9f2c-5da7e74bf995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14c8701e1ad4a35a4c930cdb7bd1eda, user_id=fb2ffed955b1434ca968b814f148829c, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:33.381693 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24f91d-56af-4d8f-9f2c-5da7e74bf995 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:33.381869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e784b7-db8f-4da1-8dba-03b9366ec896 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:33.387319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1293/2558] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:33 2022] PUT /identity/v3/projects/e14c8701e1ad4a35a4c930cdb7bd1eda/users/fb2ffed955b1434ca968b814f148829c/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:33.388128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24f91d-56af-4d8f-9f2c-5da7e74bf995 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:33.390829 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fb24f91d-56af-4d8f-9f2c-5da7e74bf995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:33.454896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a6609-b4d6-4afa-a23a-c9f6cec82ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:33.455673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a6609-b4d6-4afa-a23a-c9f6cec82ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:33.456012 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a6609-b4d6-4afa-a23a-c9f6cec82ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:33.456288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a6609-b4d6-4afa-a23a-c9f6cec82ed1 admin admin] PATH_INFO: `/v3/projects/be92305c3d134ae58ba8611ab10b102c/users/15265219b2db4b5a94dd162a07a783ed/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:33.467321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24f91d-56af-4d8f-9f2c-5da7e74bf995 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:33.473546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:33.474098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a6609-b4d6-4afa-a23a-c9f6cec82ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be92305c3d134ae58ba8611ab10b102c, user_id=15265219b2db4b5a94dd162a07a783ed, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:33.474502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:33.474806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:33.475127 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] PATH_INFO: `/v3/users/acf486af8d1945a99f629466f5305da2` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:33.476589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf486af8d1945a99f629466f5305da2)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:33.477296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a6609-b4d6-4afa-a23a-c9f6cec82ed1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:33.478562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:33.584203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1266/2559] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:33 2022] PUT /identity/v3/projects/be92305c3d134ae58ba8611ab10b102c/users/15265219b2db4b5a94dd162a07a783ed/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:33.585757 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306d6fe-2f1a-4bac-a559-bd8ad927478f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:33.586044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306d6fe-2f1a-4bac-a559-bd8ad927478f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:33.586314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306d6fe-2f1a-4bac-a559-bd8ad927478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:33.619591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5306d6fe-2f1a-4bac-a559-bd8ad927478f None None] MFA Rules not processed for user `fb2ffed955b1434ca968b814f148829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:33.620912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5306d6fe-2f1a-4bac-a559-bd8ad927478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:33.699756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1267/2560] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:33.699756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3e14-aec8-4691-add6-178759ecd3dc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:33.699756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3e14-aec8-4691-add6-178759ecd3dc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:33.699756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3e14-aec8-4691-add6-178759ecd3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:33.725207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:33.729499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f1aa3e14-aec8-4691-add6-178759ecd3dc None None] MFA Rules not processed for user `15265219b2db4b5a94dd162a07a783ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:33.730819 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f1aa3e14-aec8-4691-add6-178759ecd3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:33.741927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf486af8d1945a99f629466f5305da2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:33.742637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf486af8d1945a99f629466f5305da2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:33.764966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf486af8d1945a99f629466f5305da2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:33.774836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf486af8d1945a99f629466f5305da2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:33.776441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf486af8d1945a99f629466f5305da2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:33.794870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:33.804010 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1268/2561] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:33.804982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa3e14-aec8-4691-add6-178759ecd3dc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:33.806355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f1aa3e14-aec8-4691-add6-178759ecd3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:33.865800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa3e14-aec8-4691-add6-178759ecd3dc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:33.869619 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed167571-b657-44ad-9b34-4f8a34b99b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:33.870222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167571-b657-44ad-9b34-4f8a34b99b1a service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:33.870500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167571-b657-44ad-9b34-4f8a34b99b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:33.870771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167571-b657-44ad-9b34-4f8a34b99b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:33.872553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ed167571-b657-44ad-9b34-4f8a34b99b1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:33.890006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed167571-b657-44ad-9b34-4f8a34b99b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:33.891113 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1294/2562] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:33 2022] DELETE /identity/v3/users/acf486af8d1945a99f629466f5305da2 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:33.891477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed167571-b657-44ad-9b34-4f8a34b99b1a service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:33.909563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1269/2563] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:33.913313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:33.914917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:34.006637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f8dd-0f29-408a-8fa8-7d5340f66e46 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:34.011644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7c54-3cdb-4c52-a794-273d03cdf4e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:34.012353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7c54-3cdb-4c52-a794-273d03cdf4e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:34.012746 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7c54-3cdb-4c52-a794-273d03cdf4e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:34.013159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7c54-3cdb-4c52-a794-273d03cdf4e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:34.081239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d7c54-3cdb-4c52-a794-273d03cdf4e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:34.082920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d7c54-3cdb-4c52-a794-273d03cdf4e5 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:34.094209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1295/2564] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:34.184296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:34.235568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:34.329850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed167571-b657-44ad-9b34-4f8a34b99b1a service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:34.331264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ed167571-b657-44ad-9b34-4f8a34b99b1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:34.405727 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed167571-b657-44ad-9b34-4f8a34b99b1a service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:34.464046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247c3f9-151e-4335-93b8-3a7a1468aa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:34.464587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247c3f9-151e-4335-93b8-3a7a1468aa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:34.464858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247c3f9-151e-4335-93b8-3a7a1468aa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:34.465119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247c3f9-151e-4335-93b8-3a7a1468aa18 admin admin] PATH_INFO: `/v3/users/df81ba6aae204b37b548b6786e958298` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:34.466287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247c3f9-151e-4335-93b8-3a7a1468aa18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df81ba6aae204b37b548b6786e958298)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:34.468272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247c3f9-151e-4335-93b8-3a7a1468aa18 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:34.534991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7c54-3cdb-4c52-a794-273d03cdf4e5 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:34.536021 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e94d7c54-3cdb-4c52-a794-273d03cdf4e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:34.558591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7c54-3cdb-4c52-a794-273d03cdf4e5 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:34.565629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:34.566310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:34.566591 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:34.566867 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] PATH_INFO: `/v3/projects/1c49e748737c44989bc512fd56c36d22` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:34.568271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c49e748737c44989bc512fd56c36d22)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:34.570249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:34.657651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:34.734914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9247c3f9-151e-4335-93b8-3a7a1468aa18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df81ba6aae204b37b548b6786e958298'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:34.736355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9247c3f9-151e-4335-93b8-3a7a1468aa18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df81ba6aae204b37b548b6786e958298'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:34.736625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c49e748737c44989bc512fd56c36d22', 'request_id': 'req-bafdda60-eaf3-475c-a1c3-2a8359c860eb'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:34.742428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c49e748737c44989bc512fd56c36d22', 'request_id': 'req-bafdda60-eaf3-475c-a1c3-2a8359c860eb'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:34.743848 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9247c3f9-151e-4335-93b8-3a7a1468aa18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df81ba6aae204b37b548b6786e958298'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:34.750168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c49e748737c44989bc512fd56c36d22', 'request_id': 'req-bafdda60-eaf3-475c-a1c3-2a8359c860eb'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:34.756757 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9247c3f9-151e-4335-93b8-3a7a1468aa18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df81ba6aae204b37b548b6786e958298'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:34.766319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:34.845814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] The token cache is being invalidate because project 1c49e748737c44989bc512fd56c36d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:34.845814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:34.845814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bafdda60-eaf3-475c-a1c3-2a8359c860eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:34.845814 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1296/2565] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:34 2022] DELETE /identity/v3/projects/1c49e748737c44989bc512fd56c36d22 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:34.848372 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b386a-5b3b-4a33-afeb-c576009cfd57 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:34.848666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b386a-5b3b-4a33-afeb-c576009cfd57 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:34.848943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b386a-5b3b-4a33-afeb-c576009cfd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:34.869458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6a0b386a-5b3b-4a33-afeb-c576009cfd57 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:34.870659 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6a0b386a-5b3b-4a33-afeb-c576009cfd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:35.054451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1297/2566] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:35.054451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f8292-afa9-4286-8df6-04e38e52cc06 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.054451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f8292-afa9-4286-8df6-04e38e52cc06 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.054451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f8292-afa9-4286-8df6-04e38e52cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.054451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0b9f8292-afa9-4286-8df6-04e38e52cc06 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:35.054451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0b9f8292-afa9-4286-8df6-04e38e52cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:35.055190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1298/2567] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:35.055190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f8292-afa9-4286-8df6-04e38e52cc06 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:35.055190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f8292-afa9-4286-8df6-04e38e52cc06 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:35.055190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a0159-aef8-4267-be76-77e1c974a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:35.055562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0159-aef8-4267-be76-77e1c974a217 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.055562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0159-aef8-4267-be76-77e1c974a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.055562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0159-aef8-4267-be76-77e1c974a217 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.055562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a0159-aef8-4267-be76-77e1c974a217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:35.055562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a0159-aef8-4267-be76-77e1c974a217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:35.055562 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a0159-aef8-4267-be76-77e1c974a217 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:35.056081 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1299/2568] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:30:35.056081 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a0159-aef8-4267-be76-77e1c974a217 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:35.056081 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a0159-aef8-4267-be76-77e1c974a217 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:35.056081 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014479-1889-4c33-9e9f-219316821483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:35.056436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014479-1889-4c33-9e9f-219316821483 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.056436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014479-1889-4c33-9e9f-219316821483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.056436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014479-1889-4c33-9e9f-219316821483 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.056436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014479-1889-4c33-9e9f-219316821483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:35.056436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014479-1889-4c33-9e9f-219316821483 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:35.056865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9247c3f9-151e-4335-93b8-3a7a1468aa18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df81ba6aae204b37b548b6786e958298'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:35.064761 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1270/2569] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:34 2022] DELETE /identity/v3/users/df81ba6aae204b37b548b6786e958298 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:35.072845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9da43-71ea-42a5-ba26-cb0a7c1dc356 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.073136 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9da43-71ea-42a5-ba26-cb0a7c1dc356 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.073460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9da43-71ea-42a5-ba26-cb0a7c1dc356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.093353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-cbb9da43-71ea-42a5-ba26-cb0a7c1dc356 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:35.094581 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cbb9da43-71ea-42a5-ba26-cb0a7c1dc356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:35.158543 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1271/2570] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:35.169987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9da43-71ea-42a5-ba26-cb0a7c1dc356 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:35.171458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cbb9da43-71ea-42a5-ba26-cb0a7c1dc356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:35.185207 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1300/2571] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:35 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:35.190078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014479-1889-4c33-9e9f-219316821483 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:35.192477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3a014479-1889-4c33-9e9f-219316821483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:35.218290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:35.234584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9da43-71ea-42a5-ba26-cb0a7c1dc356 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:35.288992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014479-1889-4c33-9e9f-219316821483 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:35.294985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b8e82-9665-4462-a617-f94c2e560af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:35.294985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b8e82-9665-4462-a617-f94c2e560af1 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.295271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b8e82-9665-4462-a617-f94c2e560af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.295749 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b8e82-9665-4462-a617-f94c2e560af1 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.296472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b8e82-9665-4462-a617-f94c2e560af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:35.312158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:35.312158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b8e82-9665-4462-a617-f94c2e560af1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:35.323273 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56755-7d65-453f-aa27-55fcfc5ad92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:35.323884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56755-7d65-453f-aa27-55fcfc5ad92b service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.324161 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56755-7d65-453f-aa27-55fcfc5ad92b service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.324477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56755-7d65-453f-aa27-55fcfc5ad92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.337740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56755-7d65-453f-aa27-55fcfc5ad92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:35.340497 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56755-7d65-453f-aa27-55fcfc5ad92b service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:35.354771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1272/2572] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:35.430761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1301/2573] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:35 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:35.435107 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56755-7d65-453f-aa27-55fcfc5ad92b service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:35.450876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56755-7d65-453f-aa27-55fcfc5ad92b service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:35.460654 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68366f7-0645-46a4-b003-e6c18f8bccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:35.461343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68366f7-0645-46a4-b003-e6c18f8bccc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.461635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68366f7-0645-46a4-b003-e6c18f8bccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.461903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68366f7-0645-46a4-b003-e6c18f8bccc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.462684 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68366f7-0645-46a4-b003-e6c18f8bccc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:35.464298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68366f7-0645-46a4-b003-e6c18f8bccc6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:35.476350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1273/2574] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:35.480448 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b8e82-9665-4462-a617-f94c2e560af1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:35.491626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b8e82-9665-4462-a617-f94c2e560af1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:35.497135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382b7f0-d6da-4686-963d-81c28f743460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:35.497135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b7f0-d6da-4686-963d-81c28f743460 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.497135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b7f0-d6da-4686-963d-81c28f743460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.497500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b7f0-d6da-4686-963d-81c28f743460 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.498858 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382b7f0-d6da-4686-963d-81c28f743460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:35.500466 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382b7f0-d6da-4686-963d-81c28f743460 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:35.510388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1302/2575] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:35.514927 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68366f7-0645-46a4-b003-e6c18f8bccc6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:35.525966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68366f7-0645-46a4-b003-e6c18f8bccc6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:35.532121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d4012-5028-488e-b12c-8b6085f32332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:35.532900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d4012-5028-488e-b12c-8b6085f32332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.533176 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d4012-5028-488e-b12c-8b6085f32332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.533486 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d4012-5028-488e-b12c-8b6085f32332 admin admin] PATH_INFO: `/v3/projects/e68178d6e12741338272b42168cac0fb/users/3a753aafc15f46368f423ac29655542e/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.551638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d4012-5028-488e-b12c-8b6085f32332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68178d6e12741338272b42168cac0fb, user_id=3a753aafc15f46368f423ac29655542e, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:35.561234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d4012-5028-488e-b12c-8b6085f32332 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:35.642724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1274/2576] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:35 2022] PUT /identity/v3/projects/e68178d6e12741338272b42168cac0fb/users/3a753aafc15f46368f423ac29655542e/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:35.653321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028018-a99c-46ec-9d1c-441872befddd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.653620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028018-a99c-46ec-9d1c-441872befddd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.653891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028018-a99c-46ec-9d1c-441872befddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.701458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fe028018-a99c-46ec-9d1c-441872befddd None None] MFA Rules not processed for user `3a753aafc15f46368f423ac29655542e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:35.702752 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fe028018-a99c-46ec-9d1c-441872befddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:35.791529 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1303/2577] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:35.796813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d4012-5028-488e-b12c-8b6085f32332 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:35.843344 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe028018-a99c-46ec-9d1c-441872befddd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:35.845545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fe028018-a99c-46ec-9d1c-441872befddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:35.862394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:35.888387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d4012-5028-488e-b12c-8b6085f32332 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:35.895232 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89dfb-688b-409f-8e23-cfa72a33abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:35.895843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89dfb-688b-409f-8e23-cfa72a33abda admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.896120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89dfb-688b-409f-8e23-cfa72a33abda admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.896389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89dfb-688b-409f-8e23-cfa72a33abda admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.897028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89dfb-688b-409f-8e23-cfa72a33abda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:35.899213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89dfb-688b-409f-8e23-cfa72a33abda admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:35.931985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe028018-a99c-46ec-9d1c-441872befddd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:35.936786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:35.937484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:35.937761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:35.938036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] PATH_INFO: `/v3/projects/08769ad7c59d4946b791d20de1ec4dd0` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:35.939273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] RBAC: Authorizing `identity:delete_project(project_id=08769ad7c59d4946b791d20de1ec4dd0)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:35.941287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:36.007685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1275/2578] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:35 2022] POST /identity/v3/projects => generated 393 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:36.011711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89dfb-688b-409f-8e23-cfa72a33abda admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:36.038474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08769ad7c59d4946b791d20de1ec4dd0', 'request_id': 'req-aee8920f-05c6-4158-bedc-d2a4cc01014d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:36.044377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08769ad7c59d4946b791d20de1ec4dd0', 'request_id': 'req-aee8920f-05c6-4158-bedc-d2a4cc01014d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:36.051891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08769ad7c59d4946b791d20de1ec4dd0', 'request_id': 'req-aee8920f-05c6-4158-bedc-d2a4cc01014d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:36.070743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:36.088259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89dfb-688b-409f-8e23-cfa72a33abda admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:36.131224 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] The token cache is being invalidate because project 08769ad7c59d4946b791d20de1ec4dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:36.131515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:36.132180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:36.133966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1304/2579] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:35 2022] DELETE /identity/v3/projects/08769ad7c59d4946b791d20de1ec4dd0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:36.137883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:36.142023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:36.152100 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262caa1-6b4d-44c4-b401-4c92655e8fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:36.152811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262caa1-6b4d-44c4-b401-4c92655e8fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:36.153097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262caa1-6b4d-44c4-b401-4c92655e8fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:36.153402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262caa1-6b4d-44c4-b401-4c92655e8fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:36.154060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262caa1-6b4d-44c4-b401-4c92655e8fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:36.157255 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262caa1-6b4d-44c4-b401-4c92655e8fb6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:36.214118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8920f-05c6-4158-bedc-d2a4cc01014d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:36.219146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2783d1e-9545-4559-bed9-a6799a33ee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:36.219780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2783d1e-9545-4559-bed9-a6799a33ee48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:36.220059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2783d1e-9545-4559-bed9-a6799a33ee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:36.220339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2783d1e-9545-4559-bed9-a6799a33ee48 admin admin] PATH_INFO: `/v3/users/fb2ffed955b1434ca968b814f148829c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:36.221500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2783d1e-9545-4559-bed9-a6799a33ee48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2ffed955b1434ca968b814f148829c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:36.223435 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2783d1e-9545-4559-bed9-a6799a33ee48 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:36.273740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1276/2580] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:36 2022] POST /identity/v3/users => generated 303 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:36.277822 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262caa1-6b4d-44c4-b401-4c92655e8fb6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:36.279858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f262caa1-6b4d-44c4-b401-4c92655e8fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:36.292382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262caa1-6b4d-44c4-b401-4c92655e8fb6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:36.298028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf72c77-245b-4d44-bb1e-5da65c5a2375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:36.298649 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf72c77-245b-4d44-bb1e-5da65c5a2375 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:36.298980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf72c77-245b-4d44-bb1e-5da65c5a2375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:36.299247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf72c77-245b-4d44-bb1e-5da65c5a2375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:36.299912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf72c77-245b-4d44-bb1e-5da65c5a2375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:36.301620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf72c77-245b-4d44-bb1e-5da65c5a2375 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:36.312466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1277/2581] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:36.316646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf72c77-245b-4d44-bb1e-5da65c5a2375 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:36.327089 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf72c77-245b-4d44-bb1e-5da65c5a2375 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:36.332893 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ea004-add7-4716-9f34-63422946c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:36.335155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea004-add7-4716-9f34-63422946c3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:36.335155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea004-add7-4716-9f34-63422946c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:36.335155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea004-add7-4716-9f34-63422946c3c8 admin admin] PATH_INFO: `/v3/projects/4750b68fb7aa4d9bb5fc247367137fbd/users/4510b71afdbe4fbe825c3a3d8c383799/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:36.351734 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ea004-add7-4716-9f34-63422946c3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4750b68fb7aa4d9bb5fc247367137fbd, user_id=4510b71afdbe4fbe825c3a3d8c383799, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:36.354377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ea004-add7-4716-9f34-63422946c3c8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:36.483469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1278/2582] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:36 2022] PUT /identity/v3/projects/4750b68fb7aa4d9bb5fc247367137fbd/users/4510b71afdbe4fbe825c3a3d8c383799/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:36.488087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ea004-add7-4716-9f34-63422946c3c8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:36.511297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:36.516071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e2783d1e-9545-4559-bed9-a6799a33ee48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2ffed955b1434ca968b814f148829c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:36.517643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e2783d1e-9545-4559-bed9-a6799a33ee48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2ffed955b1434ca968b814f148829c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:36.535566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e2783d1e-9545-4559-bed9-a6799a33ee48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2ffed955b1434ca968b814f148829c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:36.545718 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e2783d1e-9545-4559-bed9-a6799a33ee48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2ffed955b1434ca968b814f148829c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:36.547128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e2783d1e-9545-4559-bed9-a6799a33ee48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2ffed955b1434ca968b814f148829c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:36.569122 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ea004-add7-4716-9f34-63422946c3c8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:36.574044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230969ad-099e-4742-b4c8-dee8bfbc1797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:36.574642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230969ad-099e-4742-b4c8-dee8bfbc1797 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:36.574915 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230969ad-099e-4742-b4c8-dee8bfbc1797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:36.575183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230969ad-099e-4742-b4c8-dee8bfbc1797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:36.575809 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230969ad-099e-4742-b4c8-dee8bfbc1797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:36.577595 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230969ad-099e-4742-b4c8-dee8bfbc1797 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:36.589324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1279/2583] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:36.597055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230969ad-099e-4742-b4c8-dee8bfbc1797 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:36.597055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-230969ad-099e-4742-b4c8-dee8bfbc1797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:36.610060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230969ad-099e-4742-b4c8-dee8bfbc1797 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:36.619684 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1948-3cd8-4d0c-881a-3664bd051403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:36.620699 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1948-3cd8-4d0c-881a-3664bd051403 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:36.621028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1948-3cd8-4d0c-881a-3664bd051403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:36.621271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1948-3cd8-4d0c-881a-3664bd051403 admin admin] PATH_INFO: `/v3/projects/4750b68fb7aa4d9bb5fc247367137fbd/users/4510b71afdbe4fbe825c3a3d8c383799/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:36.623800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1948-3cd8-4d0c-881a-3664bd051403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4750b68fb7aa4d9bb5fc247367137fbd, user_id=4510b71afdbe4fbe825c3a3d8c383799, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:36.625505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1305/2584] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:36 2022] DELETE /identity/v3/users/fb2ffed955b1434ca968b814f148829c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:36.628569 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1948-3cd8-4d0c-881a-3664bd051403 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:36.638400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1280/2585] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:36 2022] PUT /identity/v3/projects/4750b68fb7aa4d9bb5fc247367137fbd/users/4510b71afdbe4fbe825c3a3d8c383799/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:36.650819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229fa22-c7b4-4b12-a77d-c18ae4595f93 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:36.651103 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229fa22-c7b4-4b12-a77d-c18ae4595f93 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:36.654790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229fa22-c7b4-4b12-a77d-c18ae4595f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:36.687417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4229fa22-c7b4-4b12-a77d-c18ae4595f93 None None] MFA Rules not processed for user `4510b71afdbe4fbe825c3a3d8c383799`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:36.688618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4229fa22-c7b4-4b12-a77d-c18ae4595f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:36.772073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1306/2586] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:36.790075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1948-3cd8-4d0c-881a-3664bd051403 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:36.791337 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-698d1948-3cd8-4d0c-881a-3664bd051403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:36.834909 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:36.877691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1948-3cd8-4d0c-881a-3664bd051403 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:36.904954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb06605-4165-4785-ba99-fe904bcc78d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:36.905833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb06605-4165-4785-ba99-fe904bcc78d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:36.906117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb06605-4165-4785-ba99-fe904bcc78d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:36.907503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb06605-4165-4785-ba99-fe904bcc78d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:36.918719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb06605-4165-4785-ba99-fe904bcc78d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:36.920443 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb06605-4165-4785-ba99-fe904bcc78d2 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:36.932262 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1281/2587] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:36.992874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229fa22-c7b4-4b12-a77d-c18ae4595f93 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:37.004809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229fa22-c7b4-4b12-a77d-c18ae4595f93 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:37.009080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164f8a1-3b72-4ca3-a24c-d09ebf521dab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:37.009831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164f8a1-3b72-4ca3-a24c-d09ebf521dab service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:37.010097 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164f8a1-3b72-4ca3-a24c-d09ebf521dab service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:37.010931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164f8a1-3b72-4ca3-a24c-d09ebf521dab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:37.014496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2164f8a1-3b72-4ca3-a24c-d09ebf521dab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:37.085456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164f8a1-3b72-4ca3-a24c-d09ebf521dab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:37.086899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164f8a1-3b72-4ca3-a24c-d09ebf521dab service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:37.096787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1307/2588] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:37.106416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb06605-4165-4785-ba99-fe904bcc78d2 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:37.108782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ecb06605-4165-4785-ba99-fe904bcc78d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:37.202026 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb06605-4165-4785-ba99-fe904bcc78d2 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:37.207180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:37.207835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:37.208110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:37.208416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] PATH_INFO: `/v3/projects/e14c8701e1ad4a35a4c930cdb7bd1eda` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:37.209870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14c8701e1ad4a35a4c930cdb7bd1eda)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:37.211783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:37.367410 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14c8701e1ad4a35a4c930cdb7bd1eda', 'request_id': 'req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:37.373743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14c8701e1ad4a35a4c930cdb7bd1eda', 'request_id': 'req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:37.491577 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14c8701e1ad4a35a4c930cdb7bd1eda', 'request_id': 'req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:37.504401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] The token cache is being invalidate because project e14c8701e1ad4a35a4c930cdb7bd1eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:37.504693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:37.505599 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:37.507455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1282/2589] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:37 2022] DELETE /identity/v3/projects/e14c8701e1ad4a35a4c930cdb7bd1eda => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:37.512218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5b100-463f-4962-8cb7-a173bcb69d0a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:37.512500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5b100-463f-4962-8cb7-a173bcb69d0a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:37.512771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5b100-463f-4962-8cb7-a173bcb69d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:37.538594 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6ee5b100-463f-4962-8cb7-a173bcb69d0a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:37.539824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6ee5b100-463f-4962-8cb7-a173bcb69d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:37.554730 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:37.557031 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:37.584445 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:37.611496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1308/2590] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:37.613092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6edb8a-5528-4110-9386-d3a32671308c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:37.613439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6edb8a-5528-4110-9386-d3a32671308c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:37.613714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6edb8a-5528-4110-9386-d3a32671308c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:37.635107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ff6edb8a-5528-4110-9386-d3a32671308c None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:37.636314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ff6edb8a-5528-4110-9386-d3a32671308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:37.645121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00ee8-0efb-4ddb-8a1c-f33c12cf8185 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:37.650407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1309/2591] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:37.651810 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6edb8a-5528-4110-9386-d3a32671308c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:37.656227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:37.657103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:37.657813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:37.658250 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] PATH_INFO: `/v3/users/7fb4b69d229846ae8429ce9f38385091` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:37.660620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb4b69d229846ae8429ce9f38385091)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:37.662941 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:37.663084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6edb8a-5528-4110-9386-d3a32671308c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:37.666259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:37.670775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f595c8-edf3-4210-a463-55455d5b34fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:37.672154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f595c8-edf3-4210-a463-55455d5b34fb admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:37.672154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f595c8-edf3-4210-a463-55455d5b34fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:37.672154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f595c8-edf3-4210-a463-55455d5b34fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:37.672573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f595c8-edf3-4210-a463-55455d5b34fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:37.672870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f595c8-edf3-4210-a463-55455d5b34fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:37.674719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f595c8-edf3-4210-a463-55455d5b34fb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:37.688712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1310/2592] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:37.693287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f595c8-edf3-4210-a463-55455d5b34fb admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:37.704118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f595c8-edf3-4210-a463-55455d5b34fb admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:37.709354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bb345-111b-4ea7-938a-54d76cce5421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:37.710008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bb345-111b-4ea7-938a-54d76cce5421 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:37.710317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bb345-111b-4ea7-938a-54d76cce5421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:37.710590 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bb345-111b-4ea7-938a-54d76cce5421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:37.711221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bb345-111b-4ea7-938a-54d76cce5421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:37.713268 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bb345-111b-4ea7-938a-54d76cce5421 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:37.842792 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1311/2593] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:37 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:37.847543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bb345-111b-4ea7-938a-54d76cce5421 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:37.847543 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9c2bb345-111b-4ea7-938a-54d76cce5421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:37.871428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb4b69d229846ae8429ce9f38385091'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:37.872024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb4b69d229846ae8429ce9f38385091'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:37.882801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb4b69d229846ae8429ce9f38385091'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:37.900914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb4b69d229846ae8429ce9f38385091'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:37.955051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bb345-111b-4ea7-938a-54d76cce5421 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:37.960334 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:37.961045 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:37.961311 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:37.961618 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] PATH_INFO: `/v3/users/15265219b2db4b5a94dd162a07a783ed` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:37.962880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15265219b2db4b5a94dd162a07a783ed)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:37.964920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:37.988210 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb4b69d229846ae8429ce9f38385091'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:38.001702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1283/2594] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:37 2022] DELETE /identity/v3/users/7fb4b69d229846ae8429ce9f38385091 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:38.005971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:38.007770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:38.078840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb5f21-1fa8-4f12-aacd-a264984f5144 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:38.088102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d01c5-4090-41da-a590-be56f219b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:38.088813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d01c5-4090-41da-a590-be56f219b8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:38.089163 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d01c5-4090-41da-a590-be56f219b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:38.089524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d01c5-4090-41da-a590-be56f219b8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:38.090259 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d01c5-4090-41da-a590-be56f219b8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:38.092290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d01c5-4090-41da-a590-be56f219b8c3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:38.145776 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15265219b2db4b5a94dd162a07a783ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:38.146587 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15265219b2db4b5a94dd162a07a783ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:38.160425 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15265219b2db4b5a94dd162a07a783ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:38.167538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15265219b2db4b5a94dd162a07a783ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:38.174483 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15265219b2db4b5a94dd162a07a783ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:38.202222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1284/2595] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:38 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:38.202222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8876-0517-4d6e-aac9-83621a11930f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:38.202875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8876-0517-4d6e-aac9-83621a11930f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:38.202875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8876-0517-4d6e-aac9-83621a11930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:38.223234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a5fb8876-0517-4d6e-aac9-83621a11930f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:38.224430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a5fb8876-0517-4d6e-aac9-83621a11930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:38.233121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1285/2596] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:38.236750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb8876-0517-4d6e-aac9-83621a11930f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:38.236750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a5fb8876-0517-4d6e-aac9-83621a11930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:38.247454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb8876-0517-4d6e-aac9-83621a11930f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:38.252162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5511a-4fd3-4d92-a2c7-8e1cbf4e2f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:38.252840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5511a-4fd3-4d92-a2c7-8e1cbf4e2f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:38.253119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5511a-4fd3-4d92-a2c7-8e1cbf4e2f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:38.253416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5511a-4fd3-4d92-a2c7-8e1cbf4e2f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:38.254058 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5511a-4fd3-4d92-a2c7-8e1cbf4e2f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:38.255638 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5511a-4fd3-4d92-a2c7-8e1cbf4e2f88 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:38.266185 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1286/2597] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:38.270326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5511a-4fd3-4d92-a2c7-8e1cbf4e2f88 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:38.277538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-84a5511a-4fd3-4d92-a2c7-8e1cbf4e2f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:38.277743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1312/2598] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:37 2022] DELETE /identity/v3/users/15265219b2db4b5a94dd162a07a783ed => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:38.279428 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:38.310495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:38.351645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813febf4-55d7-48df-90c4-2f1f2df7d0b5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:38.355714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5511a-4fd3-4d92-a2c7-8e1cbf4e2f88 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:38.356740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89b8dc-42c1-47c5-9177-1e8be5c33153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:38.357422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b8dc-42c1-47c5-9177-1e8be5c33153 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:38.357703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b8dc-42c1-47c5-9177-1e8be5c33153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:38.357972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b8dc-42c1-47c5-9177-1e8be5c33153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:38.358608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89b8dc-42c1-47c5-9177-1e8be5c33153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:38.360411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89b8dc-42c1-47c5-9177-1e8be5c33153 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:38.361314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:38.371201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1313/2599] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:38.372542 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27505a3-e877-4ded-9a26-cd308dfca511 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:38.373252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27505a3-e877-4ded-9a26-cd308dfca511 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:38.373791 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27505a3-e877-4ded-9a26-cd308dfca511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:38.396322 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d27505a3-e877-4ded-9a26-cd308dfca511 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:38.397745 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d27505a3-e877-4ded-9a26-cd308dfca511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:38.406982 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1314/2600] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:38.407870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27505a3-e877-4ded-9a26-cd308dfca511 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:38.418204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27505a3-e877-4ded-9a26-cd308dfca511 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:38.421281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4445-4db9-4144-8852-e45ccf3160ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:38.421945 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4445-4db9-4144-8852-e45ccf3160ed service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:38.422227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4445-4db9-4144-8852-e45ccf3160ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:38.422500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d4445-4db9-4144-8852-e45ccf3160ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:38.423480 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc93fe3-24d0-441a-b445-2fd244270060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:38.424144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc93fe3-24d0-441a-b445-2fd244270060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:38.424421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc93fe3-24d0-441a-b445-2fd244270060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:38.424697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc93fe3-24d0-441a-b445-2fd244270060 admin admin] PATH_INFO: `/v3/projects/dd08bb90ec904ac08c714d1c847d435b/users/f5462e64c91947eb9d57d49fee9b5700/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:38.432483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d4445-4db9-4144-8852-e45ccf3160ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:38.434038 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d4445-4db9-4144-8852-e45ccf3160ed service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:38.441582 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc93fe3-24d0-441a-b445-2fd244270060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd08bb90ec904ac08c714d1c847d435b, user_id=f5462e64c91947eb9d57d49fee9b5700, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:38.444352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc93fe3-24d0-441a-b445-2fd244270060 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:38.445341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1287/2601] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:38.446112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4445-4db9-4144-8852-e45ccf3160ed service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:38.455466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d4445-4db9-4144-8852-e45ccf3160ed service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:38.459480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138e733-6147-45eb-bbf3-aed1b49f7a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:38.461741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138e733-6147-45eb-bbf3-aed1b49f7a22 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:38.461741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138e733-6147-45eb-bbf3-aed1b49f7a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:38.461741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138e733-6147-45eb-bbf3-aed1b49f7a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:38.474064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138e733-6147-45eb-bbf3-aed1b49f7a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:38.475490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138e733-6147-45eb-bbf3-aed1b49f7a22 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:38.487073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1288/2602] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:38.522314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1315/2603] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:38 2022] PUT /identity/v3/projects/dd08bb90ec904ac08c714d1c847d435b/users/f5462e64c91947eb9d57d49fee9b5700/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:38.533019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d50d-bf69-4bed-89aa-fe4147780f82 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:38.533396 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d50d-bf69-4bed-89aa-fe4147780f82 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:38.533750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d50d-bf69-4bed-89aa-fe4147780f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:38.567099 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-92d5d50d-bf69-4bed-89aa-fe4147780f82 None None] MFA Rules not processed for user `f5462e64c91947eb9d57d49fee9b5700`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:38.568657 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-92d5d50d-bf69-4bed-89aa-fe4147780f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:38.647124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1289/2604] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:38.651822 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc93fe3-24d0-441a-b445-2fd244270060 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:38.765150 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc93fe3-24d0-441a-b445-2fd244270060 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:38.771573 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670ac63-1266-411e-9215-6d3b916eaae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:38.772197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670ac63-1266-411e-9215-6d3b916eaae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:38.772476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670ac63-1266-411e-9215-6d3b916eaae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:38.772747 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670ac63-1266-411e-9215-6d3b916eaae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:38.773540 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670ac63-1266-411e-9215-6d3b916eaae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:38.777420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670ac63-1266-411e-9215-6d3b916eaae4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:38.906542 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5d50d-bf69-4bed-89aa-fe4147780f82 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:38.910174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1316/2605] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:38 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:38.924626 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5d50d-bf69-4bed-89aa-fe4147780f82 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:38.990876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3d4b-dc7a-4d78-ad75-95367596ad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:38.991484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3d4b-dc7a-4d78-ad75-95367596ad89 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:38.991754 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3d4b-dc7a-4d78-ad75-95367596ad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:38.992018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3d4b-dc7a-4d78-ad75-95367596ad89 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:38.992700 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f3d4b-dc7a-4d78-ad75-95367596ad89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:38.995835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f3d4b-dc7a-4d78-ad75-95367596ad89 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:39.053613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670ac63-1266-411e-9215-6d3b916eaae4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:39.059164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9670ac63-1266-411e-9215-6d3b916eaae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:39.071680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670ac63-1266-411e-9215-6d3b916eaae4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:39.078508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:39.079740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:39.080307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:39.081242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] PATH_INFO: `/v3/projects/33c12a4f16f34ff48ca0d632ba56aa0e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:39.082579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c12a4f16f34ff48ca0d632ba56aa0e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:39.093275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1290/2606] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:38 2022] POST /identity/v3/users => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:39.094141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3d4b-dc7a-4d78-ad75-95367596ad89 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:39.096142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:39.097162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c64f3d4b-dc7a-4d78-ad75-95367596ad89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:39.116207 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3d4b-dc7a-4d78-ad75-95367596ad89 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:39.122248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:39.123055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:39.123382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:39.123926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] PATH_INFO: `/v3/projects/be92305c3d134ae58ba8611ab10b102c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:39.125732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be92305c3d134ae58ba8611ab10b102c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:39.127459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:39.142748 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:39.260809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c12a4f16f34ff48ca0d632ba56aa0e', 'request_id': 'req-236f5211-4142-4530-84a5-26b1c3bf2e41'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.268525 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c12a4f16f34ff48ca0d632ba56aa0e', 'request_id': 'req-236f5211-4142-4530-84a5-26b1c3bf2e41'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.275319 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c12a4f16f34ff48ca0d632ba56aa0e', 'request_id': 'req-236f5211-4142-4530-84a5-26b1c3bf2e41'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.276351 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be92305c3d134ae58ba8611ab10b102c', 'request_id': 'req-d607f737-e7a4-4a22-a407-520b566c976f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.281788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:39.289428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be92305c3d134ae58ba8611ab10b102c', 'request_id': 'req-d607f737-e7a4-4a22-a407-520b566c976f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.355708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] The token cache is being invalidate because project 33c12a4f16f34ff48ca0d632ba56aa0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:39.356271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.357875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.359756 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1317/2607] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:39 2022] DELETE /identity/v3/projects/33c12a4f16f34ff48ca0d632ba56aa0e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:39.362499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:39.366071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:39.411189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be92305c3d134ae58ba8611ab10b102c', 'request_id': 'req-d607f737-e7a4-4a22-a407-520b566c976f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.424551 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] The token cache is being invalidate because project be92305c3d134ae58ba8611ab10b102c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:39.424841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.425650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.427719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1291/2608] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:39 2022] DELETE /identity/v3/projects/be92305c3d134ae58ba8611ab10b102c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:39.428704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:39.431698 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:39.514341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f5211-4142-4530-84a5-26b1c3bf2e41 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:39.573172 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607f737-e7a4-4a22-a407-520b566c976f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:39.590458 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:39.591113 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:39.591434 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:39.591762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] PATH_INFO: `/v3/users/313e603c32744f24852bc7b3bd6784c8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:39.592951 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=313e603c32744f24852bc7b3bd6784c8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:39.607572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:39.625696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d671c55-4405-4ed4-86c1-ccde984343b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:39.628368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d671c55-4405-4ed4-86c1-ccde984343b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:39.628368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d671c55-4405-4ed4-86c1-ccde984343b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:39.628368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d671c55-4405-4ed4-86c1-ccde984343b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:39.628368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d671c55-4405-4ed4-86c1-ccde984343b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:39.630035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d671c55-4405-4ed4-86c1-ccde984343b0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:39.646725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1318/2609] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:39.649099 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980de6e5-ba34-4dec-9dde-fd8f1bf73b72 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:39.650711 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980de6e5-ba34-4dec-9dde-fd8f1bf73b72 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:39.662266 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980de6e5-ba34-4dec-9dde-fd8f1bf73b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:39.676350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-980de6e5-ba34-4dec-9dde-fd8f1bf73b72 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:39.677885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-980de6e5-ba34-4dec-9dde-fd8f1bf73b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:39.695284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1319/2610] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:39.695284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980de6e5-ba34-4dec-9dde-fd8f1bf73b72 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:39.695284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-980de6e5-ba34-4dec-9dde-fd8f1bf73b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:39.707950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980de6e5-ba34-4dec-9dde-fd8f1bf73b72 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:39.713625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9d706-5960-4dc2-abc5-b371755d3f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:39.714560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d706-5960-4dc2-abc5-b371755d3f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:39.720118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d706-5960-4dc2-abc5-b371755d3f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:39.720118 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d706-5960-4dc2-abc5-b371755d3f80 admin admin] PATH_INFO: `/v3/projects/97db329236184d54a99b24fcd1d2a301/users/3da1ef242dce4da19e5e1dd7e036a34b/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:39.739151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9d706-5960-4dc2-abc5-b371755d3f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97db329236184d54a99b24fcd1d2a301, user_id=3da1ef242dce4da19e5e1dd7e036a34b, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:39.742736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9d706-5960-4dc2-abc5-b371755d3f80 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:39.831996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313e603c32744f24852bc7b3bd6784c8'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.832912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313e603c32744f24852bc7b3bd6784c8'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.847952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313e603c32744f24852bc7b3bd6784c8'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.852022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1320/2611] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:39 2022] PUT /identity/v3/projects/97db329236184d54a99b24fcd1d2a301/users/3da1ef242dce4da19e5e1dd7e036a34b/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:39.853981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5773a-0742-48ce-9553-59181e5693fc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:39.854345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5773a-0742-48ce-9553-59181e5693fc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:39.854857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5773a-0742-48ce-9553-59181e5693fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:39.882403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313e603c32744f24852bc7b3bd6784c8'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.893579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4dc5773a-0742-48ce-9553-59181e5693fc None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:39.902020 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4dc5773a-0742-48ce-9553-59181e5693fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:39.984017 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313e603c32744f24852bc7b3bd6784c8'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:39.991502 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1292/2612] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:39 2022] DELETE /identity/v3/users/313e603c32744f24852bc7b3bd6784c8 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:39.992462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:39.994072 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:40.021879 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:40.027209 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1321/2613] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:40.032490 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5773a-0742-48ce-9553-59181e5693fc None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:40.051855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5773a-0742-48ce-9553-59181e5693fc None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:40.070843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:40.084598 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62290b11-c94d-4dd7-a666-5bccc54d5689 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:40.090338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228468-bd27-4f13-808d-1cf64de3d2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:40.093002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228468-bd27-4f13-808d-1cf64de3d2be admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:40.093562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228468-bd27-4f13-808d-1cf64de3d2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:40.094015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228468-bd27-4f13-808d-1cf64de3d2be admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:40.094840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5228468-bd27-4f13-808d-1cf64de3d2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:40.097237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5228468-bd27-4f13-808d-1cf64de3d2be admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:40.110436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1293/2614] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:40.114139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228468-bd27-4f13-808d-1cf64de3d2be admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:40.129280 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228468-bd27-4f13-808d-1cf64de3d2be admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:40.135465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722c5b4-b68b-48ac-8096-ac514cf4709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:40.136914 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c5b4-b68b-48ac-8096-ac514cf4709a admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:40.137353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c5b4-b68b-48ac-8096-ac514cf4709a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:40.137873 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c5b4-b68b-48ac-8096-ac514cf4709a admin admin] PATH_INFO: `/v3/projects/97db329236184d54a99b24fcd1d2a301/users/3da1ef242dce4da19e5e1dd7e036a34b/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:40.140993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722c5b4-b68b-48ac-8096-ac514cf4709a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97db329236184d54a99b24fcd1d2a301, user_id=3da1ef242dce4da19e5e1dd7e036a34b, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:40.145501 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722c5b4-b68b-48ac-8096-ac514cf4709a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:40.164267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1294/2615] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:40 2022] PUT /identity/v3/projects/97db329236184d54a99b24fcd1d2a301/users/3da1ef242dce4da19e5e1dd7e036a34b/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:40.175418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d24d-ea62-4cfe-9f33-df35e551f682 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:40.175939 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d24d-ea62-4cfe-9f33-df35e551f682 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:40.176394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d24d-ea62-4cfe-9f33-df35e551f682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:40.205779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d497d37-29c6-4fd3-94e1-58574c9fe1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:40.206080 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d497d37-29c6-4fd3-94e1-58574c9fe1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:40.206356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d497d37-29c6-4fd3-94e1-58574c9fe1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:40.206623 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d497d37-29c6-4fd3-94e1-58574c9fe1a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:40.207269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d497d37-29c6-4fd3-94e1-58574c9fe1a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:40.207570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d497d37-29c6-4fd3-94e1-58574c9fe1a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:40.209181 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d497d37-29c6-4fd3-94e1-58574c9fe1a0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:40.237712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1322/2616] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:40.242579 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2632d24d-ea62-4cfe-9f33-df35e551f682 None None] MFA Rules not processed for user `3da1ef242dce4da19e5e1dd7e036a34b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:40.245080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2632d24d-ea62-4cfe-9f33-df35e551f682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:40.245500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d497d37-29c6-4fd3-94e1-58574c9fe1a0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:40.284252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d497d37-29c6-4fd3-94e1-58574c9fe1a0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:40.405076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f21fa7-c87d-477e-829e-a845fe8f5888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:40.406333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21fa7-c87d-477e-829e-a845fe8f5888 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:40.406620 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21fa7-c87d-477e-829e-a845fe8f5888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:40.406998 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f21fa7-c87d-477e-829e-a845fe8f5888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:40.407877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1295/2617] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:40.408348 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f21fa7-c87d-477e-829e-a845fe8f5888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:40.413421 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f21fa7-c87d-477e-829e-a845fe8f5888 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:40.472604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632d24d-ea62-4cfe-9f33-df35e551f682 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:40.472604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2632d24d-ea62-4cfe-9f33-df35e551f682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:40.527034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632d24d-ea62-4cfe-9f33-df35e551f682 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:40.531750 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1323/2618] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:40 2022] POST /identity/v3/projects => generated 371 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:40.532639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308eba-f5c7-4482-a5d1-fb6047d942d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:40.533475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308eba-f5c7-4482-a5d1-fb6047d942d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:40.533743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308eba-f5c7-4482-a5d1-fb6047d942d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:40.533974 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308eba-f5c7-4482-a5d1-fb6047d942d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:40.537939 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f21fa7-c87d-477e-829e-a845fe8f5888 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:40.546181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f308eba-f5c7-4482-a5d1-fb6047d942d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:40.551028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f308eba-f5c7-4482-a5d1-fb6047d942d3 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:40.558155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1296/2619] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:40.614595 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f21fa7-c87d-477e-829e-a845fe8f5888 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:40.617660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa456-54e8-4620-83d5-516b852189e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:40.618330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa456-54e8-4620-83d5-516b852189e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:40.618629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa456-54e8-4620-83d5-516b852189e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:40.618946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa456-54e8-4620-83d5-516b852189e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:40.619515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aa456-54e8-4620-83d5-516b852189e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:40.621517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aa456-54e8-4620-83d5-516b852189e6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:40.664692 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308eba-f5c7-4482-a5d1-fb6047d942d3 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:40.666315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4f308eba-f5c7-4482-a5d1-fb6047d942d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:40.681211 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308eba-f5c7-4482-a5d1-fb6047d942d3 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:40.687839 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:40.688583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:40.688870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:40.693524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] PATH_INFO: `/v3/projects/c49aa66596784f5d8682fe088874aa90` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:40.699275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49aa66596784f5d8682fe088874aa90)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:40.699275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:40.754886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1324/2620] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:40 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:40.761528 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa456-54e8-4620-83d5-516b852189e6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:40.772950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa456-54e8-4620-83d5-516b852189e6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:40.777675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369af08-7662-4801-850b-74ebbc82b695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:40.778263 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369af08-7662-4801-850b-74ebbc82b695 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:40.779737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369af08-7662-4801-850b-74ebbc82b695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:40.779737 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369af08-7662-4801-850b-74ebbc82b695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:40.780175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369af08-7662-4801-850b-74ebbc82b695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:40.781795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369af08-7662-4801-850b-74ebbc82b695 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:40.791613 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1325/2621] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:40.792386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369af08-7662-4801-850b-74ebbc82b695 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:40.801342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:40.832400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:40.857947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49aa66596784f5d8682fe088874aa90', 'request_id': 'req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:40.869558 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49aa66596784f5d8682fe088874aa90', 'request_id': 'req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:40.870070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369af08-7662-4801-850b-74ebbc82b695 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:40.922042 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c69609-7b69-441e-a273-234830ef10d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:40.923517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69609-7b69-441e-a273-234830ef10d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:40.923517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69609-7b69-441e-a273-234830ef10d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:40.923517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69609-7b69-441e-a273-234830ef10d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:40.925168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-64c69609-7b69-441e-a273-234830ef10d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:40.942524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49aa66596784f5d8682fe088874aa90', 'request_id': 'req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:40.954377 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] The token cache is being invalidate because project c49aa66596784f5d8682fe088874aa90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:40.954714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:40.955477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:40.961049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1297/2622] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:40 2022] DELETE /identity/v3/projects/c49aa66596784f5d8682fe088874aa90 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:40.961049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:40.961049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:40.989833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c69609-7b69-441e-a273-234830ef10d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:40.991254 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c69609-7b69-441e-a273-234830ef10d7 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:41.001950 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1326/2623] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:41.003417 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e8a92-1ffa-440d-8235-c5b10ce82fc6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.003786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e8a92-1ffa-440d-8235-c5b10ce82fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.004153 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e8a92-1ffa-440d-8235-c5b10ce82fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.032157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ce5e8a92-1ffa-440d-8235-c5b10ce82fc6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:41.032157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ce5e8a92-1ffa-440d-8235-c5b10ce82fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:41.061819 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ca2c9-6d57-44f3-9a5b-8e0e7e0b05cb admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:41.070077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1461-6e6c-4cb3-a176-78859f09dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:41.070688 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1461-6e6c-4cb3-a176-78859f09dcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.070960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1461-6e6c-4cb3-a176-78859f09dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.071364 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1461-6e6c-4cb3-a176-78859f09dcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.072009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba1461-6e6c-4cb3-a176-78859f09dcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:41.073617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba1461-6e6c-4cb3-a176-78859f09dcb1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:41.086513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1298/2624] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:41.091875 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1461-6e6c-4cb3-a176-78859f09dcb1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:41.102417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1461-6e6c-4cb3-a176-78859f09dcb1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:41.107438 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b51e4-6da9-42c8-b69e-b4deadc0fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:41.108083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b51e4-6da9-42c8-b69e-b4deadc0fee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.108510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b51e4-6da9-42c8-b69e-b4deadc0fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.112724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b51e4-6da9-42c8-b69e-b4deadc0fee3 admin admin] PATH_INFO: `/v3/projects/7294bb7c67f94750bca7f610e9cc70c6/users/45b862b3c8b84ab9b7a167241ed7bd3a/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.113932 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1327/2625] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:41.122308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cf43a-0d5f-498e-95e3-e14a592579a8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.123512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cf43a-0d5f-498e-95e3-e14a592579a8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.124102 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cf43a-0d5f-498e-95e3-e14a592579a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.127000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b51e4-6da9-42c8-b69e-b4deadc0fee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7294bb7c67f94750bca7f610e9cc70c6, user_id=45b862b3c8b84ab9b7a167241ed7bd3a, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:41.129929 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b51e4-6da9-42c8-b69e-b4deadc0fee3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:41.148770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-067cf43a-0d5f-498e-95e3-e14a592579a8 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:41.150396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-067cf43a-0d5f-498e-95e3-e14a592579a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:41.159192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1328/2626] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:41.163107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cf43a-0d5f-498e-95e3-e14a592579a8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:41.173011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cf43a-0d5f-498e-95e3-e14a592579a8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:41.180862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8515d-205b-4f8d-8b83-4e81198c6447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:41.181503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8515d-205b-4f8d-8b83-4e81198c6447 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.181782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8515d-205b-4f8d-8b83-4e81198c6447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.182056 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8515d-205b-4f8d-8b83-4e81198c6447 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.182739 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8515d-205b-4f8d-8b83-4e81198c6447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:41.183038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8515d-205b-4f8d-8b83-4e81198c6447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:41.184794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8515d-205b-4f8d-8b83-4e81198c6447 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:41.197552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:41.201412 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1329/2627] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:41.204873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8515d-205b-4f8d-8b83-4e81198c6447 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:41.217743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8515d-205b-4f8d-8b83-4e81198c6447 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:41.227043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b85489-bf32-47b1-87dc-7c3698a57b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:41.227043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85489-bf32-47b1-87dc-7c3698a57b2c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.227043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85489-bf32-47b1-87dc-7c3698a57b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.227043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85489-bf32-47b1-87dc-7c3698a57b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.227399 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b85489-bf32-47b1-87dc-7c3698a57b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:41.227399 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b85489-bf32-47b1-87dc-7c3698a57b2c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:41.254906 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1299/2628] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:41 2022] PUT /identity/v3/projects/7294bb7c67f94750bca7f610e9cc70c6/users/45b862b3c8b84ab9b7a167241ed7bd3a/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:41.267036 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b897-ea66-4fa3-a890-b2b0e8c3d2c7 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.267585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b897-ea66-4fa3-a890-b2b0e8c3d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.268240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b897-ea66-4fa3-a890-b2b0e8c3d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.295639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ebe6b897-ea66-4fa3-a890-b2b0e8c3d2c7 None None] MFA Rules not processed for user `45b862b3c8b84ab9b7a167241ed7bd3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:41.296859 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ebe6b897-ea66-4fa3-a890-b2b0e8c3d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:41.339228 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1330/2629] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:41 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:41.343251 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b85489-bf32-47b1-87dc-7c3698a57b2c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:41.380901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1300/2630] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:41.396823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6b897-ea66-4fa3-a890-b2b0e8c3d2c7 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:41.398460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ebe6b897-ea66-4fa3-a890-b2b0e8c3d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:41.425479 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:41.453710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b85489-bf32-47b1-87dc-7c3698a57b2c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:41.458794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace714b-c243-49a0-a723-cb308b66ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:41.461396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace714b-c243-49a0-a723-cb308b66ecc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.461396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace714b-c243-49a0-a723-cb308b66ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.461396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace714b-c243-49a0-a723-cb308b66ecc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.461396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace714b-c243-49a0-a723-cb308b66ecc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:41.462841 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace714b-c243-49a0-a723-cb308b66ecc2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:41.476227 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6b897-ea66-4fa3-a890-b2b0e8c3d2c7 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:41.528729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b915d-57fe-4c99-8f88-804f9dc19297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:41.529338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b915d-57fe-4c99-8f88-804f9dc19297 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.529669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b915d-57fe-4c99-8f88-804f9dc19297 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.529954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b915d-57fe-4c99-8f88-804f9dc19297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.585880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b915d-57fe-4c99-8f88-804f9dc19297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:41.587484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b915d-57fe-4c99-8f88-804f9dc19297 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:41.596583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1301/2631] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:41.597461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b915d-57fe-4c99-8f88-804f9dc19297 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:41.598851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e91b915d-57fe-4c99-8f88-804f9dc19297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:41.612508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1331/2632] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:41 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:41.618144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace714b-c243-49a0-a723-cb308b66ecc2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:41.618420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b915d-57fe-4c99-8f88-804f9dc19297 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:41.625254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:41.625934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.626209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.626528 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] PATH_INFO: `/v3/users/f5462e64c91947eb9d57d49fee9b5700` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.627685 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5462e64c91947eb9d57d49fee9b5700)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:41.629825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace714b-c243-49a0-a723-cb308b66ecc2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:41.630009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:41.634622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f531-6665-4985-be6c-d97019ad6d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:41.635218 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f531-6665-4985-be6c-d97019ad6d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.635497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f531-6665-4985-be6c-d97019ad6d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.635768 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f531-6665-4985-be6c-d97019ad6d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.636407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78f531-6665-4985-be6c-d97019ad6d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:41.638173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78f531-6665-4985-be6c-d97019ad6d0b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:41.648685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1332/2633] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:41.649456 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f531-6665-4985-be6c-d97019ad6d0b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:41.659656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f531-6665-4985-be6c-d97019ad6d0b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:41.664217 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:41.664827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.665101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.665392 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] PATH_INFO: `/v3/users/45b862b3c8b84ab9b7a167241ed7bd3a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.666507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b862b3c8b84ab9b7a167241ed7bd3a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:41.668393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:41.818979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5462e64c91947eb9d57d49fee9b5700'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:41.819639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5462e64c91947eb9d57d49fee9b5700'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:41.827278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5462e64c91947eb9d57d49fee9b5700'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:41.838897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5462e64c91947eb9d57d49fee9b5700'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:41.895386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b862b3c8b84ab9b7a167241ed7bd3a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:41.896085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b862b3c8b84ab9b7a167241ed7bd3a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:41.908546 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5462e64c91947eb9d57d49fee9b5700'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:41.912209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:41.913137 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b862b3c8b84ab9b7a167241ed7bd3a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:41.921763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1302/2634] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:41 2022] DELETE /identity/v3/users/f5462e64c91947eb9d57d49fee9b5700 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:41.922822 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:41.924117 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b862b3c8b84ab9b7a167241ed7bd3a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:41.924412 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:41.925503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b862b3c8b84ab9b7a167241ed7bd3a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:41.989437 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352ebf1-1db3-4dbd-bbb7-5a7a048609fa admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:41.994129 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dd845-f8fb-4c7a-aa50-2f60bae15b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:41.994803 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd845-f8fb-4c7a-aa50-2f60bae15b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:41.995078 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd845-f8fb-4c7a-aa50-2f60bae15b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:41.995343 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd845-f8fb-4c7a-aa50-2f60bae15b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:41.995975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dd845-f8fb-4c7a-aa50-2f60bae15b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:41.997636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dd845-f8fb-4c7a-aa50-2f60bae15b64 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:42.007648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1303/2635] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:42.008847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661bdf2-4475-4a9e-9e44-917cfaf42184 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:42.009129 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661bdf2-4475-4a9e-9e44-917cfaf42184 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:42.009460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661bdf2-4475-4a9e-9e44-917cfaf42184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:42.028036 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1333/2636] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:41 2022] DELETE /identity/v3/users/45b862b3c8b84ab9b7a167241ed7bd3a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:42.028296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9661bdf2-4475-4a9e-9e44-917cfaf42184 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:42.029687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:42.030067 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9661bdf2-4475-4a9e-9e44-917cfaf42184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:42.031171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:42.062905 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:42.090888 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1304/2637] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:42.093218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847991b6-880b-4f4b-8bec-8d6fe145ffaa None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:42.093537 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847991b6-880b-4f4b-8bec-8d6fe145ffaa None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:42.093806 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847991b6-880b-4f4b-8bec-8d6fe145ffaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:42.102756 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8e7e4-bb8e-4c56-969a-1e44f8c48227 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:42.107488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b0cd9-6f18-41e0-bdf3-049dbb9a50ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:42.108162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b0cd9-6f18-41e0-bdf3-049dbb9a50ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:42.108434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b0cd9-6f18-41e0-bdf3-049dbb9a50ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:42.108708 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b0cd9-6f18-41e0-bdf3-049dbb9a50ad admin admin] PATH_INFO: `/v3/projects/ca674341cb4e45caa02ada02bc2b1be1/users/2d9e8a78f503415eb26c86c6d2ec784f/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:42.116173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-847991b6-880b-4f4b-8bec-8d6fe145ffaa None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:42.117390 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-847991b6-880b-4f4b-8bec-8d6fe145ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:42.123979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b0cd9-6f18-41e0-bdf3-049dbb9a50ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca674341cb4e45caa02ada02bc2b1be1, user_id=2d9e8a78f503415eb26c86c6d2ec784f, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:42.125283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1305/2638] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:42.125966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847991b6-880b-4f4b-8bec-8d6fe145ffaa None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:42.126764 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b0cd9-6f18-41e0-bdf3-049dbb9a50ad admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:42.129548 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-847991b6-880b-4f4b-8bec-8d6fe145ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:42.186278 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847991b6-880b-4f4b-8bec-8d6fe145ffaa None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:42.190033 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c030d8-4841-412d-9a20-5229db32312a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:42.190633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c030d8-4841-412d-9a20-5229db32312a service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:42.190903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c030d8-4841-412d-9a20-5229db32312a service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:42.191167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c030d8-4841-412d-9a20-5229db32312a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:42.200131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c030d8-4841-412d-9a20-5229db32312a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:42.202111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c030d8-4841-412d-9a20-5229db32312a service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:42.211856 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1334/2639] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:42 2022] PUT /identity/v3/projects/ca674341cb4e45caa02ada02bc2b1be1/users/2d9e8a78f503415eb26c86c6d2ec784f/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:42.217491 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1306/2640] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:42.217625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b0cd9-6f18-41e0-bdf3-049dbb9a50ad admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:42.224828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc21e-a278-44b7-93d1-2ff08e63e86d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:42.225110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc21e-a278-44b7-93d1-2ff08e63e86d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:42.225394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc21e-a278-44b7-93d1-2ff08e63e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:42.253911 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e6cdc21e-a278-44b7-93d1-2ff08e63e86d None None] MFA Rules not processed for user `2d9e8a78f503415eb26c86c6d2ec784f`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:42.255170 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e6cdc21e-a278-44b7-93d1-2ff08e63e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:42.279900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b0cd9-6f18-41e0-bdf3-049dbb9a50ad admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:42.283918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9d0f5-b08d-49c2-b812-588742cc4fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:42.284517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9d0f5-b08d-49c2-b812-588742cc4fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:42.284790 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9d0f5-b08d-49c2-b812-588742cc4fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:42.285057 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9d0f5-b08d-49c2-b812-588742cc4fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:42.334234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1307/2641] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:42.338750 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc21e-a278-44b7-93d1-2ff08e63e86d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:42.348191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9d0f5-b08d-49c2-b812-588742cc4fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:42.349699 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9d0f5-b08d-49c2-b812-588742cc4fb2 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:42.360197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1335/2642] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:42.401813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc21e-a278-44b7-93d1-2ff08e63e86d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:42.407182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53fe7-bba8-421f-8ec1-5327eef5e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:42.407786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53fe7-bba8-421f-8ec1-5327eef5e509 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:42.408059 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53fe7-bba8-421f-8ec1-5327eef5e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:42.408323 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53fe7-bba8-421f-8ec1-5327eef5e509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:42.409005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e53fe7-bba8-421f-8ec1-5327eef5e509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:42.410976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e53fe7-bba8-421f-8ec1-5327eef5e509 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:42.507016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9d0f5-b08d-49c2-b812-588742cc4fb2 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:42.508549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-70c9d0f5-b08d-49c2-b812-588742cc4fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:42.527499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1308/2643] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:42 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:42.529323 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9d0f5-b08d-49c2-b812-588742cc4fb2 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:42.531845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53fe7-bba8-421f-8ec1-5327eef5e509 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:42.588471 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:42.636499 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53fe7-bba8-421f-8ec1-5327eef5e509 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:42.642385 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:42.643115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8f025-fccf-4aab-8f3e-a6d5c22884e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:42.645460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f025-fccf-4aab-8f3e-a6d5c22884e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:42.645741 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f025-fccf-4aab-8f3e-a6d5c22884e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:42.646014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f025-fccf-4aab-8f3e-a6d5c22884e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:42.646651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8f025-fccf-4aab-8f3e-a6d5c22884e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:42.648611 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8f025-fccf-4aab-8f3e-a6d5c22884e8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:42.657479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:42.658223 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:42.658720 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] PATH_INFO: `/v3/users/3a753aafc15f46368f423ac29655542e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:42.660055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a753aafc15f46368f423ac29655542e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:42.663369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:42.754640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:42.762271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1309/2644] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:42 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:42.762271 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8f025-fccf-4aab-8f3e-a6d5c22884e8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:42.768691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-54f8f025-fccf-4aab-8f3e-a6d5c22884e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:42.782027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8f025-fccf-4aab-8f3e-a6d5c22884e8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:42.787132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:42.787770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:42.788049 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:42.790044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] PATH_INFO: `/v3/projects/dd08bb90ec904ac08c714d1c847d435b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:42.790044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd08bb90ec904ac08c714d1c847d435b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:42.791370 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:42.896806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a753aafc15f46368f423ac29655542e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:42.897496 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a753aafc15f46368f423ac29655542e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:42.919120 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a753aafc15f46368f423ac29655542e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:42.927178 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a753aafc15f46368f423ac29655542e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:42.927899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a753aafc15f46368f423ac29655542e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:42.928689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd08bb90ec904ac08c714d1c847d435b', 'request_id': 'req-5d076101-7555-41a9-92a5-8cde5debd436'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:42.931898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:42.937379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd08bb90ec904ac08c714d1c847d435b', 'request_id': 'req-5d076101-7555-41a9-92a5-8cde5debd436'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.021135 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1336/2645] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:42 2022] DELETE /identity/v3/users/3a753aafc15f46368f423ac29655542e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:43.022025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:43.025273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:43.073484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd08bb90ec904ac08c714d1c847d435b', 'request_id': 'req-5d076101-7555-41a9-92a5-8cde5debd436'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.087816 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa884-19df-4d43-a83c-694fc713493f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:43.092760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566b9a0-6d50-4f63-bb9e-2add5e3f441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:43.093383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b9a0-6d50-4f63-bb9e-2add5e3f441d admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.093673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b9a0-6d50-4f63-bb9e-2add5e3f441d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.093941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566b9a0-6d50-4f63-bb9e-2add5e3f441d admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.094580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566b9a0-6d50-4f63-bb9e-2add5e3f441d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:43.096220 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566b9a0-6d50-4f63-bb9e-2add5e3f441d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:43.096788 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] The token cache is being invalidate because project dd08bb90ec904ac08c714d1c847d435b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:43.097076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.097786 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.099258 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1310/2646] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:42 2022] DELETE /identity/v3/projects/dd08bb90ec904ac08c714d1c847d435b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:43.102913 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:43.104176 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:43.106455 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1337/2647] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:43.108175 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e58b2b-b6a7-4a0e-893e-2017b4701c74 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.108468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e58b2b-b6a7-4a0e-893e-2017b4701c74 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.108743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e58b2b-b6a7-4a0e-893e-2017b4701c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.127558 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-37e58b2b-b6a7-4a0e-893e-2017b4701c74 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:43.128785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-37e58b2b-b6a7-4a0e-893e-2017b4701c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:43.136643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1338/2648] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:43.137732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e58b2b-b6a7-4a0e-893e-2017b4701c74 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:43.139788 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-37e58b2b-b6a7-4a0e-893e-2017b4701c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:43.152288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e58b2b-b6a7-4a0e-893e-2017b4701c74 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:43.156908 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:43.157559 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.157833 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.158106 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] PATH_INFO: `/v3/users/3da1ef242dce4da19e5e1dd7e036a34b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.159225 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da1ef242dce4da19e5e1dd7e036a34b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:43.161249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:43.170192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d076101-7555-41a9-92a5-8cde5debd436 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:43.175243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:43.178780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.178780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.178780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] PATH_INFO: `/v3/projects/7294bb7c67f94750bca7f610e9cc70c6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.178780 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7294bb7c67f94750bca7f610e9cc70c6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:43.179477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:43.378398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da1ef242dce4da19e5e1dd7e036a34b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.379019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7294bb7c67f94750bca7f610e9cc70c6', 'request_id': 'req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.379130 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da1ef242dce4da19e5e1dd7e036a34b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.385010 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7294bb7c67f94750bca7f610e9cc70c6', 'request_id': 'req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.392356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:43.393993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da1ef242dce4da19e5e1dd7e036a34b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.401241 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da1ef242dce4da19e5e1dd7e036a34b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.401997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da1ef242dce4da19e5e1dd7e036a34b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.456361 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7294bb7c67f94750bca7f610e9cc70c6', 'request_id': 'req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.468335 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] The token cache is being invalidate because project 7294bb7c67f94750bca7f610e9cc70c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:43.468625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.469338 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:43.471056 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1311/2649] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:43 2022] DELETE /identity/v3/projects/7294bb7c67f94750bca7f610e9cc70c6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:43.474488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:43.474488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:43.522493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:43.530380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1339/2650] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:43 2022] DELETE /identity/v3/users/3da1ef242dce4da19e5e1dd7e036a34b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:43.534375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:43.535828 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:43.538125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f35a1-9ccf-4ba2-9bfc-ca6291a2758e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:43.602394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5b97b-3de7-4abb-8e34-2d488192f0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:43.603066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b97b-3de7-4abb-8e34-2d488192f0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.603347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b97b-3de7-4abb-8e34-2d488192f0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.603620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b97b-3de7-4abb-8e34-2d488192f0bc admin admin] PATH_INFO: `/v3/projects/7b02d7f46fed4743a1f7e8e7d63495c7/users/29a13b3b2da54434bb1a9f1edd1d8d1a/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.609936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cde45-06fd-4b04-8fe5-4a7466c22d89 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:43.615798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a65015-e00e-4c0d-8354-f0266bfb406e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:43.615798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a65015-e00e-4c0d-8354-f0266bfb406e service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.615798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a65015-e00e-4c0d-8354-f0266bfb406e service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.615798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a65015-e00e-4c0d-8354-f0266bfb406e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.617965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b2a65015-e00e-4c0d-8354-f0266bfb406e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:43.620426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5b97b-3de7-4abb-8e34-2d488192f0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b02d7f46fed4743a1f7e8e7d63495c7, user_id=29a13b3b2da54434bb1a9f1edd1d8d1a, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:43.624744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5b97b-3de7-4abb-8e34-2d488192f0bc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:43.631668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a65015-e00e-4c0d-8354-f0266bfb406e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:43.633086 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a65015-e00e-4c0d-8354-f0266bfb406e service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:43.643688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1340/2651] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:43.644926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732133b9-937c-4075-b3c4-6e8e6cae6a9a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.645355 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732133b9-937c-4075-b3c4-6e8e6cae6a9a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.645707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732133b9-937c-4075-b3c4-6e8e6cae6a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.666999 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-732133b9-937c-4075-b3c4-6e8e6cae6a9a None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:43.668203 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-732133b9-937c-4075-b3c4-6e8e6cae6a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:43.677406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1341/2652] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:43.684941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b4b6e-fc12-4277-b9bd-718664214c20 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.685235 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b4b6e-fc12-4277-b9bd-718664214c20 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.685574 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b4b6e-fc12-4277-b9bd-718664214c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.706158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-349b4b6e-fc12-4277-b9bd-718664214c20 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:43.707048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1312/2653] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:43 2022] PUT /identity/v3/projects/7b02d7f46fed4743a1f7e8e7d63495c7/users/29a13b3b2da54434bb1a9f1edd1d8d1a/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:43.707362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-349b4b6e-fc12-4277-b9bd-718664214c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:43.715332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5b97b-3de7-4abb-8e34-2d488192f0bc admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:43.782191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1342/2654] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:43.786490 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b4b6e-fc12-4277-b9bd-718664214c20 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:43.797494 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b4b6e-fc12-4277-b9bd-718664214c20 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:43.802835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5b97b-3de7-4abb-8e34-2d488192f0bc admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:43.805283 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e0c10-4b76-4019-9ffd-dd2fddb64ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:43.806331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e0c10-4b76-4019-9ffd-dd2fddb64ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.806821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e0c10-4b76-4019-9ffd-dd2fddb64ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.807188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e0c10-4b76-4019-9ffd-dd2fddb64ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.808000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971cd2-0dc9-4a2a-9b0f-3668abc8b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:43.808566 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e0c10-4b76-4019-9ffd-dd2fddb64ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:43.808673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971cd2-0dc9-4a2a-9b0f-3668abc8b491 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.808874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971cd2-0dc9-4a2a-9b0f-3668abc8b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.809139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e0c10-4b76-4019-9ffd-dd2fddb64ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:43.809409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971cd2-0dc9-4a2a-9b0f-3668abc8b491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.809895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58971cd2-0dc9-4a2a-9b0f-3668abc8b491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:43.811222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e0c10-4b76-4019-9ffd-dd2fddb64ac2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:43.811508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58971cd2-0dc9-4a2a-9b0f-3668abc8b491 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:43.822796 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1313/2655] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:43.827674 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971cd2-0dc9-4a2a-9b0f-3668abc8b491 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:43.829413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1343/2656] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:43.833934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e0c10-4b76-4019-9ffd-dd2fddb64ac2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:43.838188 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971cd2-0dc9-4a2a-9b0f-3668abc8b491 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:43.843196 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506c4b2-8808-4ad7-8643-73b2c6d7c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:43.843874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c4b2-8808-4ad7-8643-73b2c6d7c67a admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.844183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c4b2-8808-4ad7-8643-73b2c6d7c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.844444 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506c4b2-8808-4ad7-8643-73b2c6d7c67a admin admin] PATH_INFO: `/v3/projects/7b02d7f46fed4743a1f7e8e7d63495c7/users/29a13b3b2da54434bb1a9f1edd1d8d1a/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.847132 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506c4b2-8808-4ad7-8643-73b2c6d7c67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b02d7f46fed4743a1f7e8e7d63495c7, user_id=29a13b3b2da54434bb1a9f1edd1d8d1a, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:43.847991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e0c10-4b76-4019-9ffd-dd2fddb64ac2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:43.850400 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506c4b2-8808-4ad7-8643-73b2c6d7c67a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:43.853738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4690a9-b75c-493d-81c4-4c7f28ca0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:43.854356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4690a9-b75c-493d-81c4-4c7f28ca0bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.854633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4690a9-b75c-493d-81c4-4c7f28ca0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.854911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4690a9-b75c-493d-81c4-4c7f28ca0bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.855677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4690a9-b75c-493d-81c4-4c7f28ca0bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:43.858326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4690a9-b75c-493d-81c4-4c7f28ca0bc8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:43.870783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1314/2657] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:43 2022] PUT /identity/v3/projects/7b02d7f46fed4743a1f7e8e7d63495c7/users/29a13b3b2da54434bb1a9f1edd1d8d1a/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:43.872708 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d564a6-d8af-4015-8692-5440fe732dba None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:43.873095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d564a6-d8af-4015-8692-5440fe732dba None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:43.873519 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d564a6-d8af-4015-8692-5440fe732dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:43.913247 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a8d564a6-d8af-4015-8692-5440fe732dba None None] MFA Rules not processed for user `29a13b3b2da54434bb1a9f1edd1d8d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:43.914659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a8d564a6-d8af-4015-8692-5440fe732dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:43.952085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1344/2658] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:43 2022] POST /identity/v3/projects => generated 395 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:43.956233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4690a9-b75c-493d-81c4-4c7f28ca0bc8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:43.973514 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:44.005320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1315/2659] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:44.017397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d564a6-d8af-4015-8692-5440fe732dba None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:44.019357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a8d564a6-d8af-4015-8692-5440fe732dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:44.020214 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:44.037906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4690a9-b75c-493d-81c4-4c7f28ca0bc8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:44.043092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4bbf7-d193-4507-9936-33e5cc40feaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:44.043803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4bbf7-d193-4507-9936-33e5cc40feaf admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.044345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4bbf7-d193-4507-9936-33e5cc40feaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.044710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4bbf7-d193-4507-9936-33e5cc40feaf admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.045498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4bbf7-d193-4507-9936-33e5cc40feaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:44.047585 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4bbf7-d193-4507-9936-33e5cc40feaf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:44.084952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d564a6-d8af-4015-8692-5440fe732dba None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:44.119787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1345/2660] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:43 2022] POST /identity/v3/users => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:44.121076 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4bbf7-d193-4507-9936-33e5cc40feaf admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:44.124065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e0d4bbf7-d193-4507-9936-33e5cc40feaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:44.134841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0b798-fdd5-44f1-bd84-665d1c6720a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:44.135475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0b798-fdd5-44f1-bd84-665d1c6720a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.135752 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0b798-fdd5-44f1-bd84-665d1c6720a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.136022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0b798-fdd5-44f1-bd84-665d1c6720a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.136253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4bbf7-d193-4507-9936-33e5cc40feaf admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:44.142039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:44.142598 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.142880 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.143156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] PATH_INFO: `/v3/projects/97db329236184d54a99b24fcd1d2a301` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.144284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97db329236184d54a99b24fcd1d2a301)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:44.146257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:44.199293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0b798-fdd5-44f1-bd84-665d1c6720a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:44.201389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0b798-fdd5-44f1-bd84-665d1c6720a8 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:44.211774 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1316/2661] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:44.212603 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0b798-fdd5-44f1-bd84-665d1c6720a8 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:44.223342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0b798-fdd5-44f1-bd84-665d1c6720a8 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:44.228425 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3f6c6-7413-4f0a-8013-9d02b4b26dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:44.229034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3f6c6-7413-4f0a-8013-9d02b4b26dda admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.229319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3f6c6-7413-4f0a-8013-9d02b4b26dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.229625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3f6c6-7413-4f0a-8013-9d02b4b26dda admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.230270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3f6c6-7413-4f0a-8013-9d02b4b26dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:44.233086 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3f6c6-7413-4f0a-8013-9d02b4b26dda admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:44.243476 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1317/2662] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:44.246506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3f6c6-7413-4f0a-8013-9d02b4b26dda admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:44.246506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-48d3f6c6-7413-4f0a-8013-9d02b4b26dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:44.250980 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97db329236184d54a99b24fcd1d2a301', 'request_id': 'req-075cf9ca-6908-473f-adcb-e8a5de408d27'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.257003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97db329236184d54a99b24fcd1d2a301', 'request_id': 'req-075cf9ca-6908-473f-adcb-e8a5de408d27'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.260048 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3f6c6-7413-4f0a-8013-9d02b4b26dda admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:44.265185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97db329236184d54a99b24fcd1d2a301', 'request_id': 'req-075cf9ca-6908-473f-adcb-e8a5de408d27'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.318408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:44.319041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.319320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.319590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] PATH_INFO: `/v3/projects/e68178d6e12741338272b42168cac0fb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.321054 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68178d6e12741338272b42168cac0fb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:44.322916 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:44.376515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] The token cache is being invalidate because project 97db329236184d54a99b24fcd1d2a301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:44.376804 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.377475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.379025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1346/2663] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:44 2022] DELETE /identity/v3/projects/97db329236184d54a99b24fcd1d2a301 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:44.382831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:44.382831 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:44.403256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cf9ca-6908-473f-adcb-e8a5de408d27 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:44.403256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83291b6-5f77-468a-9f2f-28498d8cfb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:44.403256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83291b6-5f77-468a-9f2f-28498d8cfb5f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.403256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83291b6-5f77-468a-9f2f-28498d8cfb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.404356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83291b6-5f77-468a-9f2f-28498d8cfb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.404356 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83291b6-5f77-468a-9f2f-28498d8cfb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:44.404761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83291b6-5f77-468a-9f2f-28498d8cfb5f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:44.416022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1347/2664] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:44.417112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef241a-87b1-427c-b09e-6c2c74dcbb43 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.417482 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef241a-87b1-427c-b09e-6c2c74dcbb43 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.417848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef241a-87b1-427c-b09e-6c2c74dcbb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.436680 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-33ef241a-87b1-427c-b09e-6c2c74dcbb43 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:44.443287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-33ef241a-87b1-427c-b09e-6c2c74dcbb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:44.445973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1348/2665] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:44.452919 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef241a-87b1-427c-b09e-6c2c74dcbb43 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:44.457819 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef241a-87b1-427c-b09e-6c2c74dcbb43 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:44.462772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d90c60-55a9-43bd-b555-b869a80b3400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:44.463459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90c60-55a9-43bd-b555-b869a80b3400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.463736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90c60-55a9-43bd-b555-b869a80b3400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.464060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90c60-55a9-43bd-b555-b869a80b3400 admin admin] PATH_INFO: `/v3/projects/c302dc57bcc149cb8c23a86d487c1267/users/1f92ab4b37134cf4a7edd8f145ed7cdb/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.480891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d90c60-55a9-43bd-b555-b869a80b3400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c302dc57bcc149cb8c23a86d487c1267, user_id=1f92ab4b37134cf4a7edd8f145ed7cdb, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:44.484274 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d90c60-55a9-43bd-b555-b869a80b3400 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:44.514599 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:44.577416 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1349/2666] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:44 2022] PUT /identity/v3/projects/c302dc57bcc149cb8c23a86d487c1267/users/1f92ab4b37134cf4a7edd8f145ed7cdb/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:44.587607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68178d6e12741338272b42168cac0fb', 'request_id': 'req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.588486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c371de-d813-415c-ad58-ed662a8ddb05 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.588958 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c371de-d813-415c-ad58-ed662a8ddb05 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.589729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c371de-d813-415c-ad58-ed662a8ddb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.597269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68178d6e12741338272b42168cac0fb', 'request_id': 'req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.616639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d3c371de-d813-415c-ad58-ed662a8ddb05 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:44.617990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d3c371de-d813-415c-ad58-ed662a8ddb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:44.666730 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68178d6e12741338272b42168cac0fb', 'request_id': 'req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.678825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] The token cache is being invalidate because project e68178d6e12741338272b42168cac0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:44.679147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.679771 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-de5bc850-cd82-4bc0-b55c-e0d5ae6142d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.681481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1318/2667] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:44 2022] DELETE /identity/v3/projects/e68178d6e12741338272b42168cac0fb => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:44.682658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef5003-a336-4209-9e2d-79b779957ed1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.682931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef5003-a336-4209-9e2d-79b779957ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.683198 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef5003-a336-4209-9e2d-79b779957ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.684650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1350/2668] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:44.685565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c371de-d813-415c-ad58-ed662a8ddb05 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:44.686857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d3c371de-d813-415c-ad58-ed662a8ddb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:44.698706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c371de-d813-415c-ad58-ed662a8ddb05 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:44.703918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:44.704539 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.710420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.710420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] PATH_INFO: `/v3/users/4510b71afdbe4fbe825c3a3d8c383799` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.710420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4510b71afdbe4fbe825c3a3d8c383799)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:44.710420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:44.713383 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d2ef5003-a336-4209-9e2d-79b779957ed1 None None] MFA Rules not processed for user `1f92ab4b37134cf4a7edd8f145ed7cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:44.714614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d2ef5003-a336-4209-9e2d-79b779957ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:44.782050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1319/2669] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:44.785952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef5003-a336-4209-9e2d-79b779957ed1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:44.794554 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef5003-a336-4209-9e2d-79b779957ed1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:44.799357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124c4ba-453f-4890-924e-2687fe8956be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:44.799958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124c4ba-453f-4890-924e-2687fe8956be admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.800234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124c4ba-453f-4890-924e-2687fe8956be admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.800500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124c4ba-453f-4890-924e-2687fe8956be admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.801137 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124c4ba-453f-4890-924e-2687fe8956be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:44.801465 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124c4ba-453f-4890-924e-2687fe8956be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:44.803081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124c4ba-453f-4890-924e-2687fe8956be admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:44.816481 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1320/2670] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:44.819436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124c4ba-453f-4890-924e-2687fe8956be admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:44.819436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8124c4ba-453f-4890-924e-2687fe8956be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:44.832675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124c4ba-453f-4890-924e-2687fe8956be admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:44.837320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7bc0d-9f3c-4c29-877c-c54912537e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:44.837954 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7bc0d-9f3c-4c29-877c-c54912537e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:44.838257 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7bc0d-9f3c-4c29-877c-c54912537e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:44.838522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7bc0d-9f3c-4c29-877c-c54912537e39 admin admin] PATH_INFO: `/v3/users/2d9e8a78f503415eb26c86c6d2ec784f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:44.839822 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7bc0d-9f3c-4c29-877c-c54912537e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9e8a78f503415eb26c86c6d2ec784f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:44.841562 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7bc0d-9f3c-4c29-877c-c54912537e39 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:44.904771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4510b71afdbe4fbe825c3a3d8c383799'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.905509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4510b71afdbe4fbe825c3a3d8c383799'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.917272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4510b71afdbe4fbe825c3a3d8c383799'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.924042 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4510b71afdbe4fbe825c3a3d8c383799'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:44.924719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4510b71afdbe4fbe825c3a3d8c383799'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:45.004187 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1351/2671] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:44 2022] DELETE /identity/v3/users/4510b71afdbe4fbe825c3a3d8c383799 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:45.005753 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:45.007091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:45.038468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:45.047466 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:45.050968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1ce7bc0d-9f3c-4c29-877c-c54912537e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9e8a78f503415eb26c86c6d2ec784f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:45.051659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1ce7bc0d-9f3c-4c29-877c-c54912537e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9e8a78f503415eb26c86c6d2ec784f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:45.059125 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1ce7bc0d-9f3c-4c29-877c-c54912537e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9e8a78f503415eb26c86c6d2ec784f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:45.071716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03218e66-3574-4571-8c0f-0ab4877872d2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:45.073667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1ce7bc0d-9f3c-4c29-877c-c54912537e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9e8a78f503415eb26c86c6d2ec784f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:45.077643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fac363-840c-4827-be9a-86a44ef392c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:45.078376 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fac363-840c-4827-be9a-86a44ef392c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.078759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fac363-840c-4827-be9a-86a44ef392c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.079034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fac363-840c-4827-be9a-86a44ef392c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.080794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-18fac363-840c-4827-be9a-86a44ef392c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:45.140642 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fac363-840c-4827-be9a-86a44ef392c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:45.142373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fac363-840c-4827-be9a-86a44ef392c3 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:45.147813 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1ce7bc0d-9f3c-4c29-877c-c54912537e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9e8a78f503415eb26c86c6d2ec784f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:45.151138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1352/2672] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:45 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:45.151897 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fac363-840c-4827-be9a-86a44ef392c3 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:45.153151 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-18fac363-840c-4827-be9a-86a44ef392c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:45.155348 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1321/2673] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:44 2022] DELETE /identity/v3/users/2d9e8a78f503415eb26c86c6d2ec784f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:45.160127 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af1f84-9b6a-4249-be97-cf1c9dfd41fe None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.160656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af1f84-9b6a-4249-be97-cf1c9dfd41fe None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.160900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af1f84-9b6a-4249-be97-cf1c9dfd41fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.183326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d9af1f84-9b6a-4249-be97-cf1c9dfd41fe None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:45.184616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d9af1f84-9b6a-4249-be97-cf1c9dfd41fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:45.233885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fac363-840c-4827-be9a-86a44ef392c3 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:45.284711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1322/2674] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:45.295922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af1f84-9b6a-4249-be97-cf1c9dfd41fe None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:45.298194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d9af1f84-9b6a-4249-be97-cf1c9dfd41fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:45.308386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def88bd7-d83c-4e51-942a-ad0d7c43dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:45.309224 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def88bd7-d83c-4e51-942a-ad0d7c43dd0e admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.309584 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def88bd7-d83c-4e51-942a-ad0d7c43dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.310695 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def88bd7-d83c-4e51-942a-ad0d7c43dd0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.311604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def88bd7-d83c-4e51-942a-ad0d7c43dd0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:45.313787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def88bd7-d83c-4e51-942a-ad0d7c43dd0e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:45.372344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af1f84-9b6a-4249-be97-cf1c9dfd41fe None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:45.377467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e1ee6-2691-4b4f-9d6f-af1060ba92e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:45.378164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e1ee6-2691-4b4f-9d6f-af1060ba92e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.378449 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e1ee6-2691-4b4f-9d6f-af1060ba92e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.378718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e1ee6-2691-4b4f-9d6f-af1060ba92e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.389143 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e1ee6-2691-4b4f-9d6f-af1060ba92e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:45.390625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e1ee6-2691-4b4f-9d6f-af1060ba92e8 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:45.396597 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1353/2675] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:45 2022] POST /identity/v3/projects => generated 371 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:45.401051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def88bd7-d83c-4e51-942a-ad0d7c43dd0e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:45.401809 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1323/2676] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:45.407000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-def88bd7-d83c-4e51-942a-ad0d7c43dd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:45.460557 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e1ee6-2691-4b4f-9d6f-af1060ba92e8 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:45.462213 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-aa9e1ee6-2691-4b4f-9d6f-af1060ba92e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:45.480882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e1ee6-2691-4b4f-9d6f-af1060ba92e8 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:45.486929 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def88bd7-d83c-4e51-942a-ad0d7c43dd0e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:45.487309 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:45.488011 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.488288 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.488639 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] PATH_INFO: `/v3/projects/4750b68fb7aa4d9bb5fc247367137fbd` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.489905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4750b68fb7aa4d9bb5fc247367137fbd)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:45.492056 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:45.498073 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690a247-adbf-408c-81f2-93b093196500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:45.498693 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690a247-adbf-408c-81f2-93b093196500 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.498967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690a247-adbf-408c-81f2-93b093196500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.499233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690a247-adbf-408c-81f2-93b093196500 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.499857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690a247-adbf-408c-81f2-93b093196500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:45.501817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690a247-adbf-408c-81f2-93b093196500 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:45.606377 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1354/2677] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:45 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:45.611086 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690a247-adbf-408c-81f2-93b093196500 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:45.625490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4750b68fb7aa4d9bb5fc247367137fbd', 'request_id': 'req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:45.627043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690a247-adbf-408c-81f2-93b093196500 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:45.634217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4750b68fb7aa4d9bb5fc247367137fbd', 'request_id': 'req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:45.719730 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab67980-71d7-40b8-b5a0-4d3d0a6202b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:45.720347 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67980-71d7-40b8-b5a0-4d3d0a6202b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.720701 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67980-71d7-40b8-b5a0-4d3d0a6202b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.720937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67980-71d7-40b8-b5a0-4d3d0a6202b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.721611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab67980-71d7-40b8-b5a0-4d3d0a6202b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:45.723246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab67980-71d7-40b8-b5a0-4d3d0a6202b4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:45.734100 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1355/2678] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:45.738512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4750b68fb7aa4d9bb5fc247367137fbd', 'request_id': 'req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:45.741648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab67980-71d7-40b8-b5a0-4d3d0a6202b4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:45.752139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] The token cache is being invalidate because project 4750b68fb7aa4d9bb5fc247367137fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:45.752439 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:45.753119 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a03330e6-5fa8-40bd-bb2b-a0368fdeeedb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:45.759839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab67980-71d7-40b8-b5a0-4d3d0a6202b4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:45.760024 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1324/2679] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:45 2022] DELETE /identity/v3/projects/4750b68fb7aa4d9bb5fc247367137fbd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:45.761735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843ee8-934c-4344-856f-5f98aa21cd8b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.762019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843ee8-934c-4344-856f-5f98aa21cd8b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.762294 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843ee8-934c-4344-856f-5f98aa21cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.767658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0dce-9fee-473c-a1cd-8dd0c4630213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:45.769632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0dce-9fee-473c-a1cd-8dd0c4630213 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.769632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0dce-9fee-473c-a1cd-8dd0c4630213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.769632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0dce-9fee-473c-a1cd-8dd0c4630213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.769632 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a0dce-9fee-473c-a1cd-8dd0c4630213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:45.771685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a0dce-9fee-473c-a1cd-8dd0c4630213 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:45.783890 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1356/2680] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:45.787965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0dce-9fee-473c-a1cd-8dd0c4630213 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:45.788230 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a5843ee8-934c-4344-856f-5f98aa21cd8b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:45.789480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a5843ee8-934c-4344-856f-5f98aa21cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:45.789798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-155a0dce-9fee-473c-a1cd-8dd0c4630213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:45.798043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1325/2681] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:45.803946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0dce-9fee-473c-a1cd-8dd0c4630213 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:45.805759 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a8441-e97a-478f-a038-be2e545c53e6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.806041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a8441-e97a-478f-a038-be2e545c53e6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.806315 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a8441-e97a-478f-a038-be2e545c53e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.808808 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35537115-48e2-429a-87f8-f0ea477b1cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:45.809500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35537115-48e2-429a-87f8-f0ea477b1cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.810320 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35537115-48e2-429a-87f8-f0ea477b1cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.810824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35537115-48e2-429a-87f8-f0ea477b1cca admin admin] PATH_INFO: `/v3/projects/c1c13da64ab14957a12b9177c3016a2c/users/62c634e526a7473f9f0bf4c7b5f8b8e1/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.826627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4d6a8441-e97a-478f-a038-be2e545c53e6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:45.827313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35537115-48e2-429a-87f8-f0ea477b1cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c13da64ab14957a12b9177c3016a2c, user_id=62c634e526a7473f9f0bf4c7b5f8b8e1, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:45.827887 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4d6a8441-e97a-478f-a038-be2e545c53e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:45.830088 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35537115-48e2-429a-87f8-f0ea477b1cca admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:45.835647 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1326/2682] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:45.839633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a8441-e97a-478f-a038-be2e545c53e6 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:45.845171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:45.849955 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a8441-e97a-478f-a038-be2e545c53e6 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:45.853724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45abf4-b8a8-49d9-b3fe-c2dffd65391b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:45.854298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45abf4-b8a8-49d9-b3fe-c2dffd65391b admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.854591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45abf4-b8a8-49d9-b3fe-c2dffd65391b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.854858 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45abf4-b8a8-49d9-b3fe-c2dffd65391b admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.855483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45abf4-b8a8-49d9-b3fe-c2dffd65391b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:45.855775 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45abf4-b8a8-49d9-b3fe-c2dffd65391b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:45.857947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45abf4-b8a8-49d9-b3fe-c2dffd65391b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:45.869237 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1327/2683] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:30:45.874140 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45abf4-b8a8-49d9-b3fe-c2dffd65391b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:45.883334 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45abf4-b8a8-49d9-b3fe-c2dffd65391b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:45.887744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b4ec6-0a80-4d6c-a78c-2f75bafc6866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:45.888567 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b4ec6-0a80-4d6c-a78c-2f75bafc6866 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:45.888843 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b4ec6-0a80-4d6c-a78c-2f75bafc6866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:45.889116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b4ec6-0a80-4d6c-a78c-2f75bafc6866 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:45.889825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b4ec6-0a80-4d6c-a78c-2f75bafc6866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:45.892060 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b4ec6-0a80-4d6c-a78c-2f75bafc6866 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:45.931128 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1357/2684] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:45 2022] PUT /identity/v3/projects/c1c13da64ab14957a12b9177c3016a2c/users/62c634e526a7473f9f0bf4c7b5f8b8e1/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:45.934571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35537115-48e2-429a-87f8-f0ea477b1cca admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:45.934571 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-35537115-48e2-429a-87f8-f0ea477b1cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:45.954043 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:46.001656 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35537115-48e2-429a-87f8-f0ea477b1cca admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:46.005070 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1328/2685] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:45 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:46.006646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ec3c-8c6e-4a0c-a8ca-4852ab6ccdbc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:46.006828 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ec3c-8c6e-4a0c-a8ca-4852ab6ccdbc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:46.007106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ec3c-8c6e-4a0c-a8ca-4852ab6ccdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:46.032829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4f46ec3c-8c6e-4a0c-a8ca-4852ab6ccdbc None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:46.032829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4f46ec3c-8c6e-4a0c-a8ca-4852ab6ccdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:46.076031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:46.076777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:46.077096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:46.077386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] PATH_INFO: `/v3/projects/ca674341cb4e45caa02ada02bc2b1be1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:46.078793 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca674341cb4e45caa02ada02bc2b1be1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:46.080691 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:46.095326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1329/2686] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:46.096302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46ec3c-8c6e-4a0c-a8ca-4852ab6ccdbc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:46.107952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46ec3c-8c6e-4a0c-a8ca-4852ab6ccdbc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:46.112679 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f645a0-68fc-46ca-9ccb-218cac71efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:46.113286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f645a0-68fc-46ca-9ccb-218cac71efb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:46.113591 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f645a0-68fc-46ca-9ccb-218cac71efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:46.113864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f645a0-68fc-46ca-9ccb-218cac71efb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:46.114500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f645a0-68fc-46ca-9ccb-218cac71efb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:46.116410 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f645a0-68fc-46ca-9ccb-218cac71efb4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:46.210712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca674341cb4e45caa02ada02bc2b1be1', 'request_id': 'req-d4d76c66-c085-4d9c-86fd-012519be0357'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:46.216626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca674341cb4e45caa02ada02bc2b1be1', 'request_id': 'req-d4d76c66-c085-4d9c-86fd-012519be0357'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:46.227418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1330/2687] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:46 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:46.228287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f645a0-68fc-46ca-9ccb-218cac71efb4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:46.232506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c6f645a0-68fc-46ca-9ccb-218cac71efb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:46.234029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca674341cb4e45caa02ada02bc2b1be1', 'request_id': 'req-d4d76c66-c085-4d9c-86fd-012519be0357'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:46.289931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f645a0-68fc-46ca-9ccb-218cac71efb4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:46.330644 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] The token cache is being invalidate because project ca674341cb4e45caa02ada02bc2b1be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:46.330970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:46.331654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:46.333390 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1358/2688] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:45 2022] DELETE /identity/v3/projects/ca674341cb4e45caa02ada02bc2b1be1 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:46.334096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:46.336523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:46.341956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9064445-9152-451e-bade-43f7dfbd2cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:46.342577 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9064445-9152-451e-bade-43f7dfbd2cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:46.342886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9064445-9152-451e-bade-43f7dfbd2cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:46.343158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9064445-9152-451e-bade-43f7dfbd2cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:46.344975 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d9064445-9152-451e-bade-43f7dfbd2cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:46.401197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d76c66-c085-4d9c-86fd-012519be0357 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:46.406732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bc65b-736c-4bc7-aca9-b8d4048b6cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:46.407401 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc65b-736c-4bc7-aca9-b8d4048b6cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:46.407681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc65b-736c-4bc7-aca9-b8d4048b6cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:46.407954 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc65b-736c-4bc7-aca9-b8d4048b6cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:46.408598 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bc65b-736c-4bc7-aca9-b8d4048b6cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:46.409057 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9064445-9152-451e-bade-43f7dfbd2cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:46.410339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bc65b-736c-4bc7-aca9-b8d4048b6cf2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:46.410569 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9064445-9152-451e-bade-43f7dfbd2cb3 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:46.420266 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1331/2689] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:46.424124 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1359/2690] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:46.424287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9064445-9152-451e-bade-43f7dfbd2cb3 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:46.424287 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d9064445-9152-451e-bade-43f7dfbd2cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:46.425340 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bc65b-736c-4bc7-aca9-b8d4048b6cf2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:46.436664 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bc65b-736c-4bc7-aca9-b8d4048b6cf2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:46.437018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9064445-9152-451e-bade-43f7dfbd2cb3 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:46.442159 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629debec-c7f0-4296-8809-e1320c860adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:46.442373 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:46.443220 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:46.443346 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629debec-c7f0-4296-8809-e1320c860adb admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:46.443444 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:46.443555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629debec-c7f0-4296-8809-e1320c860adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:46.443764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] PATH_INFO: `/v3/users/29a13b3b2da54434bb1a9f1edd1d8d1a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:46.444031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629debec-c7f0-4296-8809-e1320c860adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:46.444740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629debec-c7f0-4296-8809-e1320c860adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:46.444933 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a13b3b2da54434bb1a9f1edd1d8d1a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:46.446420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629debec-c7f0-4296-8809-e1320c860adb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:46.446959 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:46.459799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1360/2691] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:46.461064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629debec-c7f0-4296-8809-e1320c860adb admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:46.471069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629debec-c7f0-4296-8809-e1320c860adb admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:46.475876 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0463f-29c6-4244-a977-ab48a8162105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:46.476710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0463f-29c6-4244-a977-ab48a8162105 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:46.477029 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0463f-29c6-4244-a977-ab48a8162105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:46.477407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0463f-29c6-4244-a977-ab48a8162105 admin admin] PATH_INFO: `/v3/projects/8b67e36951f3429fbdc81d720ab5e7ef/users/1af76d17c5b54b5f9139c8de613671a6/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:46.492060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0463f-29c6-4244-a977-ab48a8162105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b67e36951f3429fbdc81d720ab5e7ef, user_id=1af76d17c5b54b5f9139c8de613671a6, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:46.494739 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0463f-29c6-4244-a977-ab48a8162105 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:46.566546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1361/2692] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:46 2022] PUT /identity/v3/projects/8b67e36951f3429fbdc81d720ab5e7ef/users/1af76d17c5b54b5f9139c8de613671a6/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:46.577535 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5776a7-e3f4-429c-813a-75a2027d3816 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:46.577821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5776a7-e3f4-429c-813a-75a2027d3816 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:46.578096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5776a7-e3f4-429c-813a-75a2027d3816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:46.606472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8e5776a7-e3f4-429c-813a-75a2027d3816 None None] MFA Rules not processed for user `1af76d17c5b54b5f9139c8de613671a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:46.608463 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8e5776a7-e3f4-429c-813a-75a2027d3816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:46.623578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a13b3b2da54434bb1a9f1edd1d8d1a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:46.624314 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a13b3b2da54434bb1a9f1edd1d8d1a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:46.631680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a13b3b2da54434bb1a9f1edd1d8d1a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:46.644434 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a13b3b2da54434bb1a9f1edd1d8d1a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:46.674952 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1362/2693] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:46.687685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5776a7-e3f4-429c-813a-75a2027d3816 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:46.689071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8e5776a7-e3f4-429c-813a-75a2027d3816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:46.725233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a13b3b2da54434bb1a9f1edd1d8d1a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:46.732829 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1332/2694] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:46 2022] DELETE /identity/v3/users/29a13b3b2da54434bb1a9f1edd1d8d1a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:46.757716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5776a7-e3f4-429c-813a-75a2027d3816 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:46.789122 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:46.815579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d02e7-ae25-4859-bbe8-aa8ee148e0f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b8a5b38ac046ed8e8b98f0ecefb07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:46.816115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d02e7-ae25-4859-bbe8-aa8ee148e0f8 service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:46.816394 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d02e7-ae25-4859-bbe8-aa8ee148e0f8 service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:46.816666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d02e7-ae25-4859-bbe8-aa8ee148e0f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:46.818501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6d9d02e7-ae25-4859-bbe8-aa8ee148e0f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:46.828096 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:46.876998 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d02e7-ae25-4859-bbe8-aa8ee148e0f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:46.878485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d02e7-ae25-4859-bbe8-aa8ee148e0f8 service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:46.887475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1363/2695] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:30:47.069317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:47.157484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:47.160346 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:47.263344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0e632-b771-4f11-8d50-061787bd515a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:47.268409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:47.269055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:47.269331 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:47.269635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] PATH_INFO: `/v3/projects/7b02d7f46fed4743a1f7e8e7d63495c7` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:47.270753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b02d7f46fed4743a1f7e8e7d63495c7)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:47.272779 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:47.274433 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:47.381911 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b02d7f46fed4743a1f7e8e7d63495c7', 'request_id': 'req-d7565188-c095-4755-993a-07f607c894a5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:47.387162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b02d7f46fed4743a1f7e8e7d63495c7', 'request_id': 'req-d7565188-c095-4755-993a-07f607c894a5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:47.468426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b02d7f46fed4743a1f7e8e7d63495c7', 'request_id': 'req-d7565188-c095-4755-993a-07f607c894a5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:47.480083 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] The token cache is being invalidate because project 7b02d7f46fed4743a1f7e8e7d63495c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:47.480372 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:47.481115 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d7565188-c095-4755-993a-07f607c894a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:47.482488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1333/2696] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:47 2022] DELETE /identity/v3/projects/7b02d7f46fed4743a1f7e8e7d63495c7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:47.487479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dc509-12a5-4f8a-92a5-fe84553c572b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:47.487974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dc509-12a5-4f8a-92a5-fe84553c572b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:47.488074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dc509-12a5-4f8a-92a5-fe84553c572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:47.511781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cf0dc509-12a5-4f8a-92a5-fe84553c572b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:47.516337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cf0dc509-12a5-4f8a-92a5-fe84553c572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:47.577198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1364/2697] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:47.585157 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8473bf7-be74-4dd2-9cf9-a435e8d9098b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:47.585462 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8473bf7-be74-4dd2-9cf9-a435e8d9098b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:47.585733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8473bf7-be74-4dd2-9cf9-a435e8d9098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:47.613345 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c8473bf7-be74-4dd2-9cf9-a435e8d9098b None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:47.614533 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c8473bf7-be74-4dd2-9cf9-a435e8d9098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:47.622659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1334/2698] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:47.627197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dc509-12a5-4f8a-92a5-fe84553c572b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:47.637034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dc509-12a5-4f8a-92a5-fe84553c572b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:47.642419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e1d16-2637-4a97-80f5-81bcf0a50d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:47.643013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e1d16-2637-4a97-80f5-81bcf0a50d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:47.643324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e1d16-2637-4a97-80f5-81bcf0a50d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:47.643616 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e1d16-2637-4a97-80f5-81bcf0a50d5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:47.644257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e1d16-2637-4a97-80f5-81bcf0a50d5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:30:47.644554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e1d16-2637-4a97-80f5-81bcf0a50d5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:47.646199 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e1d16-2637-4a97-80f5-81bcf0a50d5a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:47.657614 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1365/2699] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:30:47.661738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8473bf7-be74-4dd2-9cf9-a435e8d9098b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:47.671286 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8473bf7-be74-4dd2-9cf9-a435e8d9098b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:47.676051 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08b505-34f5-455b-8abf-90c7eb53c1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:47.680503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08b505-34f5-455b-8abf-90c7eb53c1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:47.680503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08b505-34f5-455b-8abf-90c7eb53c1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:47.680503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08b505-34f5-455b-8abf-90c7eb53c1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:47.680503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08b505-34f5-455b-8abf-90c7eb53c1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:47.680503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08b505-34f5-455b-8abf-90c7eb53c1b7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:47.701416 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:47.800506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605080d-02f2-4c87-8da4-0a1a12874ee0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:47.800794 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605080d-02f2-4c87-8da4-0a1a12874ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:47.801071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605080d-02f2-4c87-8da4-0a1a12874ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:47.830985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a605080d-02f2-4c87-8da4-0a1a12874ee0 None None] MFA Rules not processed for user `62c634e526a7473f9f0bf4c7b5f8b8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:47.832418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a605080d-02f2-4c87-8da4-0a1a12874ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:47.850046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1335/2700] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:47 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:47.854124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08b505-34f5-455b-8abf-90c7eb53c1b7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:47.944733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1366/2701] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:47.945751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08b505-34f5-455b-8abf-90c7eb53c1b7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:47.949272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605080d-02f2-4c87-8da4-0a1a12874ee0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:47.950712 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a605080d-02f2-4c87-8da4-0a1a12874ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:47.950891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821596f-56d9-417b-bb9b-26dc4084ea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:47.951511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821596f-56d9-417b-bb9b-26dc4084ea96 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:47.951956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821596f-56d9-417b-bb9b-26dc4084ea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:47.952231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821596f-56d9-417b-bb9b-26dc4084ea96 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:47.952877 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821596f-56d9-417b-bb9b-26dc4084ea96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:47.955102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821596f-56d9-417b-bb9b-26dc4084ea96 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:47.964303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605080d-02f2-4c87-8da4-0a1a12874ee0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:47.969983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14a573-eaee-4301-9fc4-d21b6a81063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:47.970589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14a573-eaee-4301-9fc4-d21b6a81063c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:47.970866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14a573-eaee-4301-9fc4-d21b6a81063c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:47.971136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14a573-eaee-4301-9fc4-d21b6a81063c admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:47.971775 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14a573-eaee-4301-9fc4-d21b6a81063c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:47.973711 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14a573-eaee-4301-9fc4-d21b6a81063c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.050992 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1336/2702] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:47 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:48.055311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821596f-56d9-417b-bb9b-26dc4084ea96 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.065082 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821596f-56d9-417b-bb9b-26dc4084ea96 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.069976 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aed1a6-8812-4ba3-8fe7-3fec90181571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.070563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aed1a6-8812-4ba3-8fe7-3fec90181571 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.070860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aed1a6-8812-4ba3-8fe7-3fec90181571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.071102 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aed1a6-8812-4ba3-8fe7-3fec90181571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.072612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aed1a6-8812-4ba3-8fe7-3fec90181571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.073328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aed1a6-8812-4ba3-8fe7-3fec90181571 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.076326 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1367/2703] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:47 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:48.080304 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14a573-eaee-4301-9fc4-d21b6a81063c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.095904 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1337/2704] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:48.097242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aed1a6-8812-4ba3-8fe7-3fec90181571 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.107418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aed1a6-8812-4ba3-8fe7-3fec90181571 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.142040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14a573-eaee-4301-9fc4-d21b6a81063c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.146803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eef0e-047d-46f5-9320-f9f36abb0cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.147700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eef0e-047d-46f5-9320-f9f36abb0cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.148145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eef0e-047d-46f5-9320-f9f36abb0cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.148798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eef0e-047d-46f5-9320-f9f36abb0cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.149507 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eef0e-047d-46f5-9320-f9f36abb0cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.151437 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eef0e-047d-46f5-9320-f9f36abb0cb8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.164071 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe0082-7451-4ce0-89d6-b4f6efc11748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.164633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0082-7451-4ce0-89d6-b4f6efc11748 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.164910 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0082-7451-4ce0-89d6-b4f6efc11748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.165176 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0082-7451-4ce0-89d6-b4f6efc11748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.165847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe0082-7451-4ce0-89d6-b4f6efc11748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.167457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe0082-7451-4ce0-89d6-b4f6efc11748 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.177239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1338/2705] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:48.181461 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe0082-7451-4ce0-89d6-b4f6efc11748 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.190905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe0082-7451-4ce0-89d6-b4f6efc11748 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.195818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f25951-87f7-4a69-ad0a-9c6f04e2e0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.196450 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25951-87f7-4a69-ad0a-9c6f04e2e0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.196728 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25951-87f7-4a69-ad0a-9c6f04e2e0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.197002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25951-87f7-4a69-ad0a-9c6f04e2e0d6 admin admin] PATH_INFO: `/v3/projects/061c1c82741640ef92cb084a0ee9db5d/users/45faf5038cae470d9b3c8b43e3f5f65b/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.211960 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f25951-87f7-4a69-ad0a-9c6f04e2e0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061c1c82741640ef92cb084a0ee9db5d, user_id=45faf5038cae470d9b3c8b43e3f5f65b, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.214658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f25951-87f7-4a69-ad0a-9c6f04e2e0d6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.284505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1368/2706] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:48 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:48.284505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eef0e-047d-46f5-9320-f9f36abb0cb8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.284505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eef0e-047d-46f5-9320-f9f36abb0cb8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.284505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077665c6-4576-4ae2-bbf9-3826237da8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.285567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077665c6-4576-4ae2-bbf9-3826237da8ad admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.285567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077665c6-4576-4ae2-bbf9-3826237da8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.285567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077665c6-4576-4ae2-bbf9-3826237da8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.285567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077665c6-4576-4ae2-bbf9-3826237da8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.285567 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077665c6-4576-4ae2-bbf9-3826237da8ad admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.286894 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1369/2707] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:30:48.291255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077665c6-4576-4ae2-bbf9-3826237da8ad admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.301806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077665c6-4576-4ae2-bbf9-3826237da8ad admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.306759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543dbe3-c2f3-4ea5-b9b3-fae8fce00da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.307407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543dbe3-c2f3-4ea5-b9b3-fae8fce00da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.307687 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543dbe3-c2f3-4ea5-b9b3-fae8fce00da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.307962 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543dbe3-c2f3-4ea5-b9b3-fae8fce00da3 admin admin] PATH_INFO: `/v3/projects/54c829414b6843e787f5f3e89e64e53d/users/f9129770fa1f46fab4b54d799d90aea4/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.323714 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543dbe3-c2f3-4ea5-b9b3-fae8fce00da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c829414b6843e787f5f3e89e64e53d, user_id=f9129770fa1f46fab4b54d799d90aea4, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.326576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543dbe3-c2f3-4ea5-b9b3-fae8fce00da3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.365034 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1339/2708] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:48 2022] PUT /identity/v3/projects/061c1c82741640ef92cb084a0ee9db5d/users/45faf5038cae470d9b3c8b43e3f5f65b/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:48.377650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c1ba0-112b-4357-aa09-7c3633d6dfe3 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.377936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c1ba0-112b-4357-aa09-7c3633d6dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.378211 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c1ba0-112b-4357-aa09-7c3633d6dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.407886 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-185c1ba0-112b-4357-aa09-7c3633d6dfe3 None None] MFA Rules not processed for user `45faf5038cae470d9b3c8b43e3f5f65b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:48.409110 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-185c1ba0-112b-4357-aa09-7c3633d6dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:48.411581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1370/2709] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:48 2022] PUT /identity/v3/projects/54c829414b6843e787f5f3e89e64e53d/users/f9129770fa1f46fab4b54d799d90aea4/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:48.415551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543dbe3-c2f3-4ea5-b9b3-fae8fce00da3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.485932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1340/2710] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:30:48.490407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c1ba0-112b-4357-aa09-7c3633d6dfe3 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.496907 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543dbe3-c2f3-4ea5-b9b3-fae8fce00da3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.501870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c965eb0-ddf6-43c1-8967-04bb147ece68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.502162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c1ba0-112b-4357-aa09-7c3633d6dfe3 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.502472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c965eb0-ddf6-43c1-8967-04bb147ece68 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.502748 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c965eb0-ddf6-43c1-8967-04bb147ece68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.503013 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c965eb0-ddf6-43c1-8967-04bb147ece68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.503647 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c965eb0-ddf6-43c1-8967-04bb147ece68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.505239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c965eb0-ddf6-43c1-8967-04bb147ece68 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.507830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:48.508739 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfa40e-6bbf-4c9b-a947-cd4448727a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.509436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfa40e-6bbf-4c9b-a947-cd4448727a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.509718 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfa40e-6bbf-4c9b-a947-cd4448727a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.510373 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfa40e-6bbf-4c9b-a947-cd4448727a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.510996 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfa40e-6bbf-4c9b-a947-cd4448727a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.513566 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfa40e-6bbf-4c9b-a947-cd4448727a47 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.519966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1371/2711] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:48.523992 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c965eb0-ddf6-43c1-8967-04bb147ece68 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.534724 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c965eb0-ddf6-43c1-8967-04bb147ece68 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.539461 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd02bf1-6038-4f82-ad6e-03495cf5cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.540142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd02bf1-6038-4f82-ad6e-03495cf5cfd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.540418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd02bf1-6038-4f82-ad6e-03495cf5cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.540688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd02bf1-6038-4f82-ad6e-03495cf5cfd6 admin admin] PATH_INFO: `/v3/projects/54c829414b6843e787f5f3e89e64e53d/users/f9129770fa1f46fab4b54d799d90aea4/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.542672 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd02bf1-6038-4f82-ad6e-03495cf5cfd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c829414b6843e787f5f3e89e64e53d, user_id=f9129770fa1f46fab4b54d799d90aea4, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.546093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd02bf1-6038-4f82-ad6e-03495cf5cfd6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.556065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1372/2712] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:48 2022] PUT /identity/v3/projects/54c829414b6843e787f5f3e89e64e53d/users/f9129770fa1f46fab4b54d799d90aea4/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:48.607344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1341/2713] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:30:48 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:30:48.611514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd02bf1-6038-4f82-ad6e-03495cf5cfd6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.619887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:48.678509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd02bf1-6038-4f82-ad6e-03495cf5cfd6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.736371 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78aef8-e57e-4920-89bb-989a9b4bb23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.736974 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78aef8-e57e-4920-89bb-989a9b4bb23e admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.737297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78aef8-e57e-4920-89bb-989a9b4bb23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.737653 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78aef8-e57e-4920-89bb-989a9b4bb23e admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.738432 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78aef8-e57e-4920-89bb-989a9b4bb23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.741025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78aef8-e57e-4920-89bb-989a9b4bb23e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.841637 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1373/2714] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:30:48 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:30:48.846572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfa40e-6bbf-4c9b-a947-cd4448727a47 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.859493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfa40e-6bbf-4c9b-a947-cd4448727a47 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.871884 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555551a-1394-4cc4-875a-1390c9b5e213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.876882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555551a-1394-4cc4-875a-1390c9b5e213 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.876882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555551a-1394-4cc4-875a-1390c9b5e213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.876882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555551a-1394-4cc4-875a-1390c9b5e213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.876882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555551a-1394-4cc4-875a-1390c9b5e213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.876882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555551a-1394-4cc4-875a-1390c9b5e213 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:48.898392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1342/2715] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:48.899685 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78aef8-e57e-4920-89bb-989a9b4bb23e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:48.915447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78aef8-e57e-4920-89bb-989a9b4bb23e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:48.921500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cb39a-bb69-4598-bf36-9d88cf2a08b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:48.922270 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb39a-bb69-4598-bf36-9d88cf2a08b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:48.922549 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb39a-bb69-4598-bf36-9d88cf2a08b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:48.922821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb39a-bb69-4598-bf36-9d88cf2a08b5 admin admin] PATH_INFO: `/v3/projects/1b3aacd3a3234049b35af469a3f71943/users/b6ed1758e5474a429ba01343093df7f9/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:48.938699 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cb39a-bb69-4598-bf36-9d88cf2a08b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3aacd3a3234049b35af469a3f71943, user_id=b6ed1758e5474a429ba01343093df7f9, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:48.941531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cb39a-bb69-4598-bf36-9d88cf2a08b5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:49.024839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1374/2716] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:48 2022] PUT /identity/v3/projects/1b3aacd3a3234049b35af469a3f71943/users/b6ed1758e5474a429ba01343093df7f9/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:49.029184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555551a-1394-4cc4-875a-1390c9b5e213 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:49.042204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555551a-1394-4cc4-875a-1390c9b5e213 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:49.045505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:49.103506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d7cf3-8797-4142-80df-c270c8527576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:49.103506 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d7cf3-8797-4142-80df-c270c8527576 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:49.103832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d7cf3-8797-4142-80df-c270c8527576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:49.104341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d7cf3-8797-4142-80df-c270c8527576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:49.105087 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d7cf3-8797-4142-80df-c270c8527576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:49.107295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d7cf3-8797-4142-80df-c270c8527576 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:49.121413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1343/2717] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:30:49.123906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cb39a-bb69-4598-bf36-9d88cf2a08b5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:49.134396 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cb39a-bb69-4598-bf36-9d88cf2a08b5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:49.140131 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16083-a1cd-4d32-8f73-9c73404c64e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:49.141112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16083-a1cd-4d32-8f73-9c73404c64e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:49.141418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16083-a1cd-4d32-8f73-9c73404c64e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:49.141698 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16083-a1cd-4d32-8f73-9c73404c64e8 admin admin] PATH_INFO: `/v3/projects/1b3aacd3a3234049b35af469a3f71943/users/b6ed1758e5474a429ba01343093df7f9/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:49.143666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d16083-a1cd-4d32-8f73-9c73404c64e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3aacd3a3234049b35af469a3f71943, user_id=b6ed1758e5474a429ba01343093df7f9, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:49.146477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d16083-a1cd-4d32-8f73-9c73404c64e8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:49.158273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1375/2718] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:30:49 2022] PUT /identity/v3/projects/1b3aacd3a3234049b35af469a3f71943/users/b6ed1758e5474a429ba01343093df7f9/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:30:49.168362 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de1d4a-f647-4f35-856c-9ec48ba522e5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:49.168848 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de1d4a-f647-4f35-856c-9ec48ba522e5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:49.169430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de1d4a-f647-4f35-856c-9ec48ba522e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:49.206149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c5de1d4a-f647-4f35-856c-9ec48ba522e5 None None] MFA Rules not processed for user `b6ed1758e5474a429ba01343093df7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:49.207381 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c5de1d4a-f647-4f35-856c-9ec48ba522e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:49.280630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1344/2719] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:49.291398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16083-a1cd-4d32-8f73-9c73404c64e8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:49.293093 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-61d16083-a1cd-4d32-8f73-9c73404c64e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:49.356064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16083-a1cd-4d32-8f73-9c73404c64e8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:49.360265 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c0c53-fc3c-41da-8ffe-736b7a1190f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:49.360870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c0c53-fc3c-41da-8ffe-736b7a1190f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:49.361145 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c0c53-fc3c-41da-8ffe-736b7a1190f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:49.361444 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c0c53-fc3c-41da-8ffe-736b7a1190f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:49.426795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c0c53-fc3c-41da-8ffe-736b7a1190f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:49.428918 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c0c53-fc3c-41da-8ffe-736b7a1190f2 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:49.442697 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1376/2720] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:49.587994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:49.687219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:50.003524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44d417-4454-4029-8c2d-19e80a3f22c1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:50.004134 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44d417-4454-4029-8c2d-19e80a3f22c1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:50.004134 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44d417-4454-4029-8c2d-19e80a3f22c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:50.033239 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8e44d417-4454-4029-8c2d-19e80a3f22c1 None None] MFA Rules not processed for user `f9129770fa1f46fab4b54d799d90aea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:50.034510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8e44d417-4454-4029-8c2d-19e80a3f22c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:50.141329 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1345/2721] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:50.151654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e77dc-094d-4421-b864-6343b254d76d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:50.151949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e77dc-094d-4421-b864-6343b254d76d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:50.152201 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e77dc-094d-4421-b864-6343b254d76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:50.171312 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cc5e77dc-094d-4421-b864-6343b254d76d None None] MFA Rules not processed for user `62c634e526a7473f9f0bf4c7b5f8b8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:50.172512 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cc5e77dc-094d-4421-b864-6343b254d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:50.264087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1377/2722] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:50.277109 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44d417-4454-4029-8c2d-19e80a3f22c1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:50.278941 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8e44d417-4454-4029-8c2d-19e80a3f22c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:50.362217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44d417-4454-4029-8c2d-19e80a3f22c1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:50.368936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce909f5-0d9f-49ca-b4fd-2e305d8ffe0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f99edbaee8504487863c6fa4b551c224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:50.369586 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce909f5-0d9f-49ca-b4fd-2e305d8ffe0d service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:50.377243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce909f5-0d9f-49ca-b4fd-2e305d8ffe0d service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:50.377243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce909f5-0d9f-49ca-b4fd-2e305d8ffe0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:50.378994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce909f5-0d9f-49ca-b4fd-2e305d8ffe0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:50.380570 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce909f5-0d9f-49ca-b4fd-2e305d8ffe0d service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:50.385244 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:50.390424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1346/2723] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:50.624973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e77dc-094d-4421-b864-6343b254d76d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:50.626524 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cc5e77dc-094d-4421-b864-6343b254d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:50.684037 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e77dc-094d-4421-b864-6343b254d76d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:50.688162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1d628-9f36-4328-be76-c01c0e841994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:50.688760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1d628-9f36-4328-be76-c01c0e841994 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:50.689025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1d628-9f36-4328-be76-c01c0e841994 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:50.689296 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1d628-9f36-4328-be76-c01c0e841994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:50.691140 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c2a1d628-9f36-4328-be76-c01c0e841994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:50.700857 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1d628-9f36-4328-be76-c01c0e841994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:50.702358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1d628-9f36-4328-be76-c01c0e841994 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:50.710429 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1378/2724] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:51.438064 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce909f5-0d9f-49ca-b4fd-2e305d8ffe0d service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:51.439585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bce909f5-0d9f-49ca-b4fd-2e305d8ffe0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:51.529745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce909f5-0d9f-49ca-b4fd-2e305d8ffe0d service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:51.539080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:51.539845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:51.540200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:51.540590 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] PATH_INFO: `/v3/users/1f92ab4b37134cf4a7edd8f145ed7cdb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:51.541876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f92ab4b37134cf4a7edd8f145ed7cdb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:51.544544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:51.786053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f92ab4b37134cf4a7edd8f145ed7cdb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:51.786756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f92ab4b37134cf4a7edd8f145ed7cdb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:51.795011 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f92ab4b37134cf4a7edd8f145ed7cdb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:51.808511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f92ab4b37134cf4a7edd8f145ed7cdb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:51.890354 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f92ab4b37134cf4a7edd8f145ed7cdb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:51.897770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1347/2725] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:30:51 2022] DELETE /identity/v3/users/1f92ab4b37134cf4a7edd8f145ed7cdb => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:51.903190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56375238-d763-43ec-9e39-31b4d60b5882 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:51.903678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56375238-d763-43ec-9e39-31b4d60b5882 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:51.903678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56375238-d763-43ec-9e39-31b4d60b5882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:51.923995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-56375238-d763-43ec-9e39-31b4d60b5882 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:30:51.928424 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-56375238-d763-43ec-9e39-31b4d60b5882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:51.992795 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:52.006476 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1379/2726] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:30:52.017944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:52.019581 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:52.092891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f2b9-f4a5-4eb8-9c9e-44645f515a2a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:52.098374 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db803c-0580-40f5-90ec-adbf1cc90595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:52.099195 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db803c-0580-40f5-90ec-adbf1cc90595 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:52.099480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db803c-0580-40f5-90ec-adbf1cc90595 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:52.099744 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db803c-0580-40f5-90ec-adbf1cc90595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:52.110429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db803c-0580-40f5-90ec-adbf1cc90595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:52.111852 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db803c-0580-40f5-90ec-adbf1cc90595 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:52.122730 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1348/2727] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:30:52.531843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56375238-d763-43ec-9e39-31b4d60b5882 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:52.533279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-56375238-d763-43ec-9e39-31b4d60b5882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:52.553262 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56375238-d763-43ec-9e39-31b4d60b5882 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:52.561434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:52.562771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:52.563250 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:52.563747 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] PATH_INFO: `/v3/projects/c302dc57bcc149cb8c23a86d487c1267` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:52.565877 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c302dc57bcc149cb8c23a86d487c1267)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:52.569777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:52.680731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c302dc57bcc149cb8c23a86d487c1267', 'request_id': 'req-261882f2-d9d0-4c18-ab18-334a724de4f7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:52.686682 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c302dc57bcc149cb8c23a86d487c1267', 'request_id': 'req-261882f2-d9d0-4c18-ab18-334a724de4f7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:52.694551 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c302dc57bcc149cb8c23a86d487c1267', 'request_id': 'req-261882f2-d9d0-4c18-ab18-334a724de4f7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:52.782163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] The token cache is being invalidate because project c302dc57bcc149cb8c23a86d487c1267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:30:52.782574 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:52.783085 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:30:52.784550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1380/2728] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:30:52 2022] DELETE /identity/v3/projects/c302dc57bcc149cb8c23a86d487c1267 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:30:54.810097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db803c-0580-40f5-90ec-adbf1cc90595 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:30:54.812166 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-26db803c-0580-40f5-90ec-adbf1cc90595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:54.844144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:30:54.881703 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db803c-0580-40f5-90ec-adbf1cc90595 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:30:54.941822 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936339fa-2b16-47f9-998e-ecdc3070ccda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:30:54.943636 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936339fa-2b16-47f9-998e-ecdc3070ccda service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:30:54.943916 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936339fa-2b16-47f9-998e-ecdc3070ccda service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:30:54.944189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936339fa-2b16-47f9-998e-ecdc3070ccda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:30:54.946389 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-936339fa-2b16-47f9-998e-ecdc3070ccda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:30:55.028823 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936339fa-2b16-47f9-998e-ecdc3070ccda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:30:55.030532 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936339fa-2b16-47f9-998e-ecdc3070ccda service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:30:55.042305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1349/2729] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:30:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:01.220605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:01.222163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:01.285987 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261882f2-d9d0-4c18-ab18-334a724de4f7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:01.290534 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:01.295173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:01.295173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:01.295173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] PATH_INFO: `/v3/users/45faf5038cae470d9b3c8b43e3f5f65b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:01.295173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=45faf5038cae470d9b3c8b43e3f5f65b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:01.295173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:01.463608 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45faf5038cae470d9b3c8b43e3f5f65b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:01.466472 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45faf5038cae470d9b3c8b43e3f5f65b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:01.476825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45faf5038cae470d9b3c8b43e3f5f65b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:01.485385 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45faf5038cae470d9b3c8b43e3f5f65b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:01.486109 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45faf5038cae470d9b3c8b43e3f5f65b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:01.547166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:01.552822 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1381/2730] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:31:01 2022] DELETE /identity/v3/users/45faf5038cae470d9b3c8b43e3f5f65b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:01.561254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a860d-4062-4402-9cbf-b5f7679df24d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:01.561898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a860d-4062-4402-9cbf-b5f7679df24d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:01.562131 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a860d-4062-4402-9cbf-b5f7679df24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:01.584266 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-020a860d-4062-4402-9cbf-b5f7679df24d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:01.585524 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-020a860d-4062-4402-9cbf-b5f7679df24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:01.649815 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1350/2731] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:01.663310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:01.665288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:01.735885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e0b7c-437b-449d-b754-dac45ab276ec admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:01.740313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e966-1a92-4738-b9cb-3ee0751f8b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:01.745248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e966-1a92-4738-b9cb-3ee0751f8b54 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:01.745248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e966-1a92-4738-b9cb-3ee0751f8b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:01.745248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e966-1a92-4738-b9cb-3ee0751f8b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:01.752308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1e966-1a92-4738-b9cb-3ee0751f8b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:01.754039 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1e966-1a92-4738-b9cb-3ee0751f8b54 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:01.764269 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1382/2732] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:02.270184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a860d-4062-4402-9cbf-b5f7679df24d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:02.271764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-020a860d-4062-4402-9cbf-b5f7679df24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:02.284510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a860d-4062-4402-9cbf-b5f7679df24d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:02.289689 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:02.290327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:02.290602 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:02.290869 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] PATH_INFO: `/v3/projects/061c1c82741640ef92cb084a0ee9db5d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:02.292016 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=061c1c82741640ef92cb084a0ee9db5d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:02.294666 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:02.322676 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:02.403835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061c1c82741640ef92cb084a0ee9db5d', 'request_id': 'req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:02.409526 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061c1c82741640ef92cb084a0ee9db5d', 'request_id': 'req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:02.478285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061c1c82741640ef92cb084a0ee9db5d', 'request_id': 'req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:02.490370 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] The token cache is being invalidate because project 061c1c82741640ef92cb084a0ee9db5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:31:02.490710 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:02.491342 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:02.492811 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1351/2733] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:31:02 2022] DELETE /identity/v3/projects/061c1c82741640ef92cb084a0ee9db5d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:02.496770 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e966-1a92-4738-b9cb-3ee0751f8b54 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:02.506862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e966-1a92-4738-b9cb-3ee0751f8b54 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:02.564223 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5bd56-a70f-4b2d-8369-5e039b64a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:02.564861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5bd56-a70f-4b2d-8369-5e039b64a065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:02.565164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5bd56-a70f-4b2d-8369-5e039b64a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:02.565468 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5bd56-a70f-4b2d-8369-5e039b64a065 admin admin] PATH_INFO: `/v3/users/b6ed1758e5474a429ba01343093df7f9` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:02.566589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5bd56-a70f-4b2d-8369-5e039b64a065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ed1758e5474a429ba01343093df7f9)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:02.568553 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5bd56-a70f-4b2d-8369-5e039b64a065 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:02.726740 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83f5bd56-a70f-4b2d-8369-5e039b64a065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ed1758e5474a429ba01343093df7f9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:02.727310 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83f5bd56-a70f-4b2d-8369-5e039b64a065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ed1758e5474a429ba01343093df7f9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:02.740404 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83f5bd56-a70f-4b2d-8369-5e039b64a065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ed1758e5474a429ba01343093df7f9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:02.747439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83f5bd56-a70f-4b2d-8369-5e039b64a065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ed1758e5474a429ba01343093df7f9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:02.748105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-83f5bd56-a70f-4b2d-8369-5e039b64a065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ed1758e5474a429ba01343093df7f9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:02.821018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1383/2734] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:31:02 2022] DELETE /identity/v3/users/b6ed1758e5474a429ba01343093df7f9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:03.285770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:03.287257 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:03.306117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16eaf7-3cb9-4218-824d-7d41f74b2bd4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:03.369460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:03.370167 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:03.370452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:03.370717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] PATH_INFO: `/v3/projects/1b3aacd3a3234049b35af469a3f71943` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:03.372052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b3aacd3a3234049b35af469a3f71943)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:03.374677 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:03.485212 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b3aacd3a3234049b35af469a3f71943', 'request_id': 'req-81248cd3-fd01-4894-b4ed-e8f98716d229'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:03.490635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b3aacd3a3234049b35af469a3f71943', 'request_id': 'req-81248cd3-fd01-4894-b4ed-e8f98716d229'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:03.559322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b3aacd3a3234049b35af469a3f71943', 'request_id': 'req-81248cd3-fd01-4894-b4ed-e8f98716d229'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:03.571764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] The token cache is being invalidate because project 1b3aacd3a3234049b35af469a3f71943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:31:03.572053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:03.572694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81248cd3-fd01-4894-b4ed-e8f98716d229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:03.574218 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1352/2735] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:31:03 2022] DELETE /identity/v3/projects/1b3aacd3a3234049b35af469a3f71943 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:03.580253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007a24-ea8b-4481-b7aa-32e26fb9abde None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:03.580751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007a24-ea8b-4481-b7aa-32e26fb9abde None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:03.581115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007a24-ea8b-4481-b7aa-32e26fb9abde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:03.603046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f9007a24-ea8b-4481-b7aa-32e26fb9abde None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:03.604281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f9007a24-ea8b-4481-b7aa-32e26fb9abde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:03.619771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:03.669963 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1384/2736] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:03.678943 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31b5d-0611-4e49-a9bd-26003f0bc772 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:03.679228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31b5d-0611-4e49-a9bd-26003f0bc772 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:03.679508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31b5d-0611-4e49-a9bd-26003f0bc772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:03.699081 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-28e31b5d-0611-4e49-a9bd-26003f0bc772 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:03.700283 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-28e31b5d-0611-4e49-a9bd-26003f0bc772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:03.708511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1353/2737] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:03.713222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007a24-ea8b-4481-b7aa-32e26fb9abde None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:03.724149 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007a24-ea8b-4481-b7aa-32e26fb9abde None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:03.729234 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e1c4-7e9d-4267-a881-53c25a76badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:03.734302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e1c4-7e9d-4267-a881-53c25a76badf admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:03.734302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e1c4-7e9d-4267-a881-53c25a76badf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:03.734302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e1c4-7e9d-4267-a881-53c25a76badf admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:03.734302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555e1c4-7e9d-4267-a881-53c25a76badf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:31:03.734302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555e1c4-7e9d-4267-a881-53c25a76badf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:03.734302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555e1c4-7e9d-4267-a881-53c25a76badf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:03.747184 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1385/2738] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:31:03.752643 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31b5d-0611-4e49-a9bd-26003f0bc772 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:03.764232 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31b5d-0611-4e49-a9bd-26003f0bc772 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:03.770276 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a897f-33fd-4abd-9f03-a8e9ec71fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:03.770988 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a897f-33fd-4abd-9f03-a8e9ec71fcee admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:03.771332 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a897f-33fd-4abd-9f03-a8e9ec71fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:03.771673 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a897f-33fd-4abd-9f03-a8e9ec71fcee admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:03.772391 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a897f-33fd-4abd-9f03-a8e9ec71fcee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:03.774668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a897f-33fd-4abd-9f03-a8e9ec71fcee admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:03.868386 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1354/2739] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:31:03 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:31:03.872736 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e1c4-7e9d-4267-a881-53c25a76badf admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:03.892607 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e1c4-7e9d-4267-a881-53c25a76badf admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:03.971381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590eb03-eb76-4c07-a5a7-0d850b6719b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:03.971993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590eb03-eb76-4c07-a5a7-0d850b6719b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:03.972381 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590eb03-eb76-4c07-a5a7-0d850b6719b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:03.972535 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590eb03-eb76-4c07-a5a7-0d850b6719b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:03.973168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590eb03-eb76-4c07-a5a7-0d850b6719b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:03.975174 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590eb03-eb76-4c07-a5a7-0d850b6719b4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:04.105815 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1386/2740] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:31:03 2022] POST /identity/v3/users => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:31:04.107120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a897f-33fd-4abd-9f03-a8e9ec71fcee admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:04.118322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a897f-33fd-4abd-9f03-a8e9ec71fcee admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:04.123413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d78662-da25-4b16-9e9d-85c350bf864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:04.124141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d78662-da25-4b16-9e9d-85c350bf864f admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:04.124484 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d78662-da25-4b16-9e9d-85c350bf864f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:04.124832 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d78662-da25-4b16-9e9d-85c350bf864f admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:04.126144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d78662-da25-4b16-9e9d-85c350bf864f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:04.127952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d78662-da25-4b16-9e9d-85c350bf864f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:04.138117 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1355/2741] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:31:04.143247 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590eb03-eb76-4c07-a5a7-0d850b6719b4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:04.153763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590eb03-eb76-4c07-a5a7-0d850b6719b4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:04.158579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e24f43-ccb5-435b-b3ed-4aa07921f3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:04.159172 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24f43-ccb5-435b-b3ed-4aa07921f3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:04.159449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24f43-ccb5-435b-b3ed-4aa07921f3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:04.159719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24f43-ccb5-435b-b3ed-4aa07921f3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:04.160353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e24f43-ccb5-435b-b3ed-4aa07921f3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:04.162006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e24f43-ccb5-435b-b3ed-4aa07921f3f2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:04.172413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1387/2742] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:31:04.176681 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d78662-da25-4b16-9e9d-85c350bf864f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:04.182147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:04.187350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d78662-da25-4b16-9e9d-85c350bf864f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:04.192500 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05955c0-a08c-4e1c-bec2-cfe1203735c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:04.193146 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05955c0-a08c-4e1c-bec2-cfe1203735c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:04.193519 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05955c0-a08c-4e1c-bec2-cfe1203735c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:04.193791 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05955c0-a08c-4e1c-bec2-cfe1203735c8 admin admin] PATH_INFO: `/v3/projects/fb5b81f86eae472abbee0b27755cfa9a/users/38d4f9ef7e144b18860f111de9a79857/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:04.210215 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05955c0-a08c-4e1c-bec2-cfe1203735c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5b81f86eae472abbee0b27755cfa9a, user_id=38d4f9ef7e144b18860f111de9a79857, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:04.212963 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05955c0-a08c-4e1c-bec2-cfe1203735c8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:04.291522 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1356/2743] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:31:04 2022] PUT /identity/v3/projects/fb5b81f86eae472abbee0b27755cfa9a/users/38d4f9ef7e144b18860f111de9a79857/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:31:04.296596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971204e-0c3e-4262-bf96-51363c9e6241 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:04.296879 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971204e-0c3e-4262-bf96-51363c9e6241 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:04.297202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971204e-0c3e-4262-bf96-51363c9e6241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:04.317068 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0971204e-0c3e-4262-bf96-51363c9e6241 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:04.318300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0971204e-0c3e-4262-bf96-51363c9e6241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:04.377022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1388/2744] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:04.387104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05955c0-a08c-4e1c-bec2-cfe1203735c8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:04.390697 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e05955c0-a08c-4e1c-bec2-cfe1203735c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:04.447074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05955c0-a08c-4e1c-bec2-cfe1203735c8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:04.450825 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee647491-0206-4e7e-a1de-686d6f16624d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:04.451427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee647491-0206-4e7e-a1de-686d6f16624d service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:04.451705 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee647491-0206-4e7e-a1de-686d6f16624d service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:04.451967 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee647491-0206-4e7e-a1de-686d6f16624d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:04.461604 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee647491-0206-4e7e-a1de-686d6f16624d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:04.463020 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee647491-0206-4e7e-a1de-686d6f16624d service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:04.472356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1357/2745] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:05.534328 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971204e-0c3e-4262-bf96-51363c9e6241 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:05.535758 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0971204e-0c3e-4262-bf96-51363c9e6241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:05.565633 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:05.593160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971204e-0c3e-4262-bf96-51363c9e6241 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:05.597508 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb5bd-8114-4b92-aebb-5b029db064eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:05.598112 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb5bd-8114-4b92-aebb-5b029db064eb service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:05.598383 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb5bd-8114-4b92-aebb-5b029db064eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:05.598647 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb5bd-8114-4b92-aebb-5b029db064eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:05.600341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d96eb5bd-8114-4b92-aebb-5b029db064eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:05.679084 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eb5bd-8114-4b92-aebb-5b029db064eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:05.680447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eb5bd-8114-4b92-aebb-5b029db064eb service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:05.694993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1389/2746] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:05.942896 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c9ce7-5276-42a9-bfd8-455fcc9d3eae None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:05.943767 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c9ce7-5276-42a9-bfd8-455fcc9d3eae None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:05.944037 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c9ce7-5276-42a9-bfd8-455fcc9d3eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:05.978293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-865c9ce7-5276-42a9-bfd8-455fcc9d3eae None None] MFA Rules not processed for user `38d4f9ef7e144b18860f111de9a79857`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:05.979838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-865c9ce7-5276-42a9-bfd8-455fcc9d3eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:06.052164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1358/2747] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:06.064297 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb5bd-8114-4b92-aebb-5b029db064eb service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:06.065751 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d96eb5bd-8114-4b92-aebb-5b029db064eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:06.077306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb5bd-8114-4b92-aebb-5b029db064eb service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:06.082300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0ea31-2b2e-4b23-afbf-57c175d8e62e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:06.083008 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0ea31-2b2e-4b23-afbf-57c175d8e62e service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:06.083353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0ea31-2b2e-4b23-afbf-57c175d8e62e service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:06.083629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0ea31-2b2e-4b23-afbf-57c175d8e62e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:06.093599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0ea31-2b2e-4b23-afbf-57c175d8e62e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:06.096248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0ea31-2b2e-4b23-afbf-57c175d8e62e service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:06.106554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1390/2748] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:07.868917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fc4a-85fc-4809-90b3-ef013000e1cc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:07.869555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fc4a-85fc-4809-90b3-ef013000e1cc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:07.869555 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fc4a-85fc-4809-90b3-ef013000e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:07.890327 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c047fc4a-85fc-4809-90b3-ef013000e1cc None None] MFA Rules not processed for user `38d4f9ef7e144b18860f111de9a79857`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:07.891664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c047fc4a-85fc-4809-90b3-ef013000e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:07.899994 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1359/2749] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:08.128544 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0ea31-2b2e-4b23-afbf-57c175d8e62e service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:08.129983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-71a0ea31-2b2e-4b23-afbf-57c175d8e62e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:08.142283 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0ea31-2b2e-4b23-afbf-57c175d8e62e service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:08.145832 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2894a40-9428-4290-8d4f-161f86dc5319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:08.146418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2894a40-9428-4290-8d4f-161f86dc5319 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:08.146696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2894a40-9428-4290-8d4f-161f86dc5319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:08.146964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2894a40-9428-4290-8d4f-161f86dc5319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:08.148636 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a2894a40-9428-4290-8d4f-161f86dc5319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:08.158569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2894a40-9428-4290-8d4f-161f86dc5319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:08.159981 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2894a40-9428-4290-8d4f-161f86dc5319 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:08.168098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1391/2750] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:13.555607 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047fc4a-85fc-4809-90b3-ef013000e1cc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:13.557574 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c047fc4a-85fc-4809-90b3-ef013000e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:13.579469 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047fc4a-85fc-4809-90b3-ef013000e1cc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:13.584575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:13.585652 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:13.589580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:13.589580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] PATH_INFO: `/v3/users/1af76d17c5b54b5f9139c8de613671a6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:13.589580 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af76d17c5b54b5f9139c8de613671a6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:13.591201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:13.803006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af76d17c5b54b5f9139c8de613671a6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:13.803693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af76d17c5b54b5f9139c8de613671a6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:13.810827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af76d17c5b54b5f9139c8de613671a6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:13.812707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:13.823068 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af76d17c5b54b5f9139c8de613671a6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:13.891042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af76d17c5b54b5f9139c8de613671a6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:13.905204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1360/2751] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:31:13 2022] DELETE /identity/v3/users/1af76d17c5b54b5f9139c8de613671a6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:13.910465 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001787d-fe18-4db0-adf0-1b67d3a34bb0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:13.911367 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001787d-fe18-4db0-adf0-1b67d3a34bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:13.911948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001787d-fe18-4db0-adf0-1b67d3a34bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:13.938014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6001787d-fe18-4db0-adf0-1b67d3a34bb0 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:13.940043 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6001787d-fe18-4db0-adf0-1b67d3a34bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:14.015441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1392/2752] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:31:14.033719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:14.033719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:14.118836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa73801-cf13-4c75-a952-c244f1c1def9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:14.122505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84768b-cdcb-442d-aac7-5cce482d5e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:14.123236 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84768b-cdcb-442d-aac7-5cce482d5e6e service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:14.124407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84768b-cdcb-442d-aac7-5cce482d5e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:14.125168 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84768b-cdcb-442d-aac7-5cce482d5e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:14.136074 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84768b-cdcb-442d-aac7-5cce482d5e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:14.137544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84768b-cdcb-442d-aac7-5cce482d5e6e service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:14.148667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1361/2753] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:14.824317 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001787d-fe18-4db0-adf0-1b67d3a34bb0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:14.825863 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6001787d-fe18-4db0-adf0-1b67d3a34bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:14.842242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001787d-fe18-4db0-adf0-1b67d3a34bb0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:14.861515 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:14.862324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:14.862517 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:14.862771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] PATH_INFO: `/v3/projects/8b67e36951f3429fbdc81d720ab5e7ef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:14.863946 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b67e36951f3429fbdc81d720ab5e7ef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:14.866051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:15.004126 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:15.007298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b67e36951f3429fbdc81d720ab5e7ef', 'request_id': 'req-b3003553-1bc9-41e3-a0e0-d7283d1923f9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:15.013213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b67e36951f3429fbdc81d720ab5e7ef', 'request_id': 'req-b3003553-1bc9-41e3-a0e0-d7283d1923f9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:15.020982 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b67e36951f3429fbdc81d720ab5e7ef', 'request_id': 'req-b3003553-1bc9-41e3-a0e0-d7283d1923f9'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:15.068222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] The token cache is being invalidate because project 8b67e36951f3429fbdc81d720ab5e7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:31:15.068579 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:15.069299 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b3003553-1bc9-41e3-a0e0-d7283d1923f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:15.074862 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1393/2754] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:31:14 2022] DELETE /identity/v3/projects/8b67e36951f3429fbdc81d720ab5e7ef => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:15.076550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d9c8c-7640-4ccf-9f67-f18eb73953d6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.077027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d9c8c-7640-4ccf-9f67-f18eb73953d6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.077112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d9c8c-7640-4ccf-9f67-f18eb73953d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.100738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6d4d9c8c-7640-4ccf-9f67-f18eb73953d6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:15.102092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6d4d9c8c-7640-4ccf-9f67-f18eb73953d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:15.179421 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1362/2755] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:15.187111 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585c6a-b616-4c7e-8f9e-0f07a4e894fe None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.187398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585c6a-b616-4c7e-8f9e-0f07a4e894fe None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.187669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585c6a-b616-4c7e-8f9e-0f07a4e894fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.208485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0d585c6a-b616-4c7e-8f9e-0f07a4e894fe None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:15.209738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0d585c6a-b616-4c7e-8f9e-0f07a4e894fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:15.217947 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1394/2756] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:15.222568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d9c8c-7640-4ccf-9f67-f18eb73953d6 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:15.232255 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d9c8c-7640-4ccf-9f67-f18eb73953d6 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:15.237709 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153c790-ee17-4ed8-ae06-1c241f664254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:15.238325 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153c790-ee17-4ed8-ae06-1c241f664254 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.238603 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153c790-ee17-4ed8-ae06-1c241f664254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.238874 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153c790-ee17-4ed8-ae06-1c241f664254 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.239521 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153c790-ee17-4ed8-ae06-1c241f664254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:31:15.239830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153c790-ee17-4ed8-ae06-1c241f664254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:15.241457 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153c790-ee17-4ed8-ae06-1c241f664254 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:15.254168 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1363/2757] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:31:15.258568 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d585c6a-b616-4c7e-8f9e-0f07a4e894fe None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:15.268406 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d585c6a-b616-4c7e-8f9e-0f07a4e894fe None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:15.273164 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419e9af-0ae1-47fc-8d47-145009c91331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:15.273796 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419e9af-0ae1-47fc-8d47-145009c91331 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.274074 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419e9af-0ae1-47fc-8d47-145009c91331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.274345 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419e9af-0ae1-47fc-8d47-145009c91331 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.274977 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419e9af-0ae1-47fc-8d47-145009c91331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:15.276885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419e9af-0ae1-47fc-8d47-145009c91331 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:15.410611 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1395/2758] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:31:15 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:31:15.414864 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153c790-ee17-4ed8-ae06-1c241f664254 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:15.425724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153c790-ee17-4ed8-ae06-1c241f664254 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:15.481258 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fd9b3-52eb-45c7-b2f7-ad00a430f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:15.481969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fd9b3-52eb-45c7-b2f7-ad00a430f988 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.482246 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fd9b3-52eb-45c7-b2f7-ad00a430f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.482505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fd9b3-52eb-45c7-b2f7-ad00a430f988 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.483235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fd9b3-52eb-45c7-b2f7-ad00a430f988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:15.486026 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fd9b3-52eb-45c7-b2f7-ad00a430f988 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:15.496670 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:15.586621 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1364/2759] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:31:15 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:31:15.590850 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419e9af-0ae1-47fc-8d47-145009c91331 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:15.602384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419e9af-0ae1-47fc-8d47-145009c91331 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:15.609318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e863703-3e89-4911-a77b-cdc860e44db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:15.609318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e863703-3e89-4911-a77b-cdc860e44db0 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.609318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e863703-3e89-4911-a77b-cdc860e44db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.609318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e863703-3e89-4911-a77b-cdc860e44db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.610766 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e863703-3e89-4911-a77b-cdc860e44db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:15.611430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e863703-3e89-4911-a77b-cdc860e44db0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:15.622286 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1396/2760] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:31:15.625979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fd9b3-52eb-45c7-b2f7-ad00a430f988 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:15.639898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fd9b3-52eb-45c7-b2f7-ad00a430f988 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:15.648075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec49e-5d25-41b3-b80a-e15d2e58ea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:15.648075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec49e-5d25-41b3-b80a-e15d2e58ea9a admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.648075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec49e-5d25-41b3-b80a-e15d2e58ea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.648075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec49e-5d25-41b3-b80a-e15d2e58ea9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.648625 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec49e-5d25-41b3-b80a-e15d2e58ea9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:15.649394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec49e-5d25-41b3-b80a-e15d2e58ea9a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:15.664610 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1365/2761] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:31:15.667255 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e863703-3e89-4911-a77b-cdc860e44db0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:15.679390 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e863703-3e89-4911-a77b-cdc860e44db0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:15.684213 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff6406-aa20-4772-a132-6ce6a3f2e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:15.684870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff6406-aa20-4772-a132-6ce6a3f2e8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.685142 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff6406-aa20-4772-a132-6ce6a3f2e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.685471 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff6406-aa20-4772-a132-6ce6a3f2e8aa admin admin] PATH_INFO: `/v3/projects/97810b4d2acd4ecbbec6e2fee456ed04/users/d459e8294d3e406c9b1a7b89932a3d80/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.702449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff6406-aa20-4772-a132-6ce6a3f2e8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=97810b4d2acd4ecbbec6e2fee456ed04, user_id=d459e8294d3e406c9b1a7b89932a3d80, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:15.706239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff6406-aa20-4772-a132-6ce6a3f2e8aa admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:15.775049 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1397/2762] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:31:15 2022] PUT /identity/v3/projects/97810b4d2acd4ecbbec6e2fee456ed04/users/d459e8294d3e406c9b1a7b89932a3d80/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:15.785480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28900b-8380-4b7c-917a-937d61d5d324 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.785831 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28900b-8380-4b7c-917a-937d61d5d324 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.786104 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28900b-8380-4b7c-917a-937d61d5d324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.814906 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3b28900b-8380-4b7c-917a-937d61d5d324 None None] MFA Rules not processed for user `d459e8294d3e406c9b1a7b89932a3d80`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:15.816103 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3b28900b-8380-4b7c-917a-937d61d5d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:15.889844 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1366/2763] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:15.902427 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff6406-aa20-4772-a132-6ce6a3f2e8aa admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:15.904157 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a2ff6406-aa20-4772-a132-6ce6a3f2e8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:15.978847 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff6406-aa20-4772-a132-6ce6a3f2e8aa admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:15.982247 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18aa85-2bc2-4e3e-b98b-d15702ebd9d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:15.982933 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18aa85-2bc2-4e3e-b98b-d15702ebd9d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.983650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18aa85-2bc2-4e3e-b98b-d15702ebd9d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.983650 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18aa85-2bc2-4e3e-b98b-d15702ebd9d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.993216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18aa85-2bc2-4e3e-b98b-d15702ebd9d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:15.994865 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18aa85-2bc2-4e3e-b98b-d15702ebd9d4 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:16.005040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1398/2764] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:17.769550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e54021-928a-4260-b2f3-28ef8f9c2b78 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:17.770097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e54021-928a-4260-b2f3-28ef8f9c2b78 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:17.770097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e54021-928a-4260-b2f3-28ef8f9c2b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:17.789961 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-24e54021-928a-4260-b2f3-28ef8f9c2b78 None None] MFA Rules not processed for user `d459e8294d3e406c9b1a7b89932a3d80`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:17.791242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-24e54021-928a-4260-b2f3-28ef8f9c2b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:17.798865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1367/2765] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:26.000229 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:27.784648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=42 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:28.771803 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8326-ddd8-427c-bb77-4e2712e2ec3c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:28.772276 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8326-ddd8-427c-bb77-4e2712e2ec3c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:28.772387 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8326-ddd8-427c-bb77-4e2712e2ec3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:28.791576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-651e8326-ddd8-427c-bb77-4e2712e2ec3c None None] MFA Rules not processed for user `38d4f9ef7e144b18860f111de9a79857`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:28.792774 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-651e8326-ddd8-427c-bb77-4e2712e2ec3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:28.847809 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1399/2766] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:31.400454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e54021-928a-4260-b2f3-28ef8f9c2b78 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:31.401919 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-24e54021-928a-4260-b2f3-28ef8f9c2b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:31.478487 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e54021-928a-4260-b2f3-28ef8f9c2b78 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:31.483258 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:31.483963 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:31.484302 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:31.484629 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] PATH_INFO: `/v3/users/62c634e526a7473f9f0bf4c7b5f8b8e1` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:31.485861 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62c634e526a7473f9f0bf4c7b5f8b8e1)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:31.487972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:31.789017 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62c634e526a7473f9f0bf4c7b5f8b8e1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:31.789899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62c634e526a7473f9f0bf4c7b5f8b8e1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:31.796880 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62c634e526a7473f9f0bf4c7b5f8b8e1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:31.809139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62c634e526a7473f9f0bf4c7b5f8b8e1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:31.944372 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62c634e526a7473f9f0bf4c7b5f8b8e1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:31.950792 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1368/2767] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:31:31 2022] DELETE /identity/v3/users/62c634e526a7473f9f0bf4c7b5f8b8e1 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:32.252158 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e8326-ddd8-427c-bb77-4e2712e2ec3c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:32.274785 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e8326-ddd8-427c-bb77-4e2712e2ec3c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:32.337836 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:32.338518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:32.338799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:32.339069 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] PATH_INFO: `/v3/projects/c1c13da64ab14957a12b9177c3016a2c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:32.340538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c13da64ab14957a12b9177c3016a2c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:32.342493 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:32.443849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c13da64ab14957a12b9177c3016a2c', 'request_id': 'req-583cbcdb-57a7-486a-b3f9-1615cea2da49'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:32.449891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c13da64ab14957a12b9177c3016a2c', 'request_id': 'req-583cbcdb-57a7-486a-b3f9-1615cea2da49'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:32.456723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c13da64ab14957a12b9177c3016a2c', 'request_id': 'req-583cbcdb-57a7-486a-b3f9-1615cea2da49'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:32.546605 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] The token cache is being invalidate because project c1c13da64ab14957a12b9177c3016a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:31:32.546887 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:32.547524 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:32.549133 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1400/2768] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:31:32 2022] DELETE /identity/v3/projects/c1c13da64ab14957a12b9177c3016a2c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:31:32.553134 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:32.554648 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:32.589824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846b28f-2b5b-41b5-9392-c7e8d2f700b9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:32.652632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:32.690414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81620c-e004-4f3c-9199-cda419a72b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:32.692850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81620c-e004-4f3c-9199-cda419a72b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:32.692850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81620c-e004-4f3c-9199-cda419a72b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:32.692850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81620c-e004-4f3c-9199-cda419a72b51 admin admin] PATH_INFO: `/v3/users/f9129770fa1f46fab4b54d799d90aea4` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:32.692850 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81620c-e004-4f3c-9199-cda419a72b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9129770fa1f46fab4b54d799d90aea4)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:32.694762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81620c-e004-4f3c-9199-cda419a72b51 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:32.870124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e81620c-e004-4f3c-9199-cda419a72b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9129770fa1f46fab4b54d799d90aea4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:32.870932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e81620c-e004-4f3c-9199-cda419a72b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9129770fa1f46fab4b54d799d90aea4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:32.878585 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e81620c-e004-4f3c-9199-cda419a72b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9129770fa1f46fab4b54d799d90aea4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:32.896732 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e81620c-e004-4f3c-9199-cda419a72b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9129770fa1f46fab4b54d799d90aea4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:32.966556 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e81620c-e004-4f3c-9199-cda419a72b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9129770fa1f46fab4b54d799d90aea4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:32.973182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1369/2769] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:31:32 2022] DELETE /identity/v3/users/f9129770fa1f46fab4b54d799d90aea4 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:33.214941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:33.216457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:33.276576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:33.302600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cbcdb-57a7-486a-b3f9-1615cea2da49 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:33.364447 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:33.367991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:33.367991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:33.367991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] PATH_INFO: `/v3/projects/54c829414b6843e787f5f3e89e64e53d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:33.367991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c829414b6843e787f5f3e89e64e53d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:33.368843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:33.527915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c829414b6843e787f5f3e89e64e53d', 'request_id': 'req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:33.527915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c829414b6843e787f5f3e89e64e53d', 'request_id': 'req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:33.535042 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c829414b6843e787f5f3e89e64e53d', 'request_id': 'req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:33.602399 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] The token cache is being invalidate because project 54c829414b6843e787f5f3e89e64e53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:31:33.602689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:33.603368 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-42591af3-9fc4-4eb6-a080-9fd0ae72a5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:33.604868 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1401/2770] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:31:33 2022] DELETE /identity/v3/projects/54c829414b6843e787f5f3e89e64e53d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:33.610002 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202f63-3e68-4e8e-8c37-0118a391c2ce None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:33.610445 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202f63-3e68-4e8e-8c37-0118a391c2ce None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:33.610716 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202f63-3e68-4e8e-8c37-0118a391c2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:33.672063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-cf202f63-3e68-4e8e-8c37-0118a391c2ce None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:33.673965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cf202f63-3e68-4e8e-8c37-0118a391c2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:33.735631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1370/2771] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:33.744643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ffb1a-9422-4757-bf0e-2da15a81de6f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:33.744926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ffb1a-9422-4757-bf0e-2da15a81de6f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:33.745197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ffb1a-9422-4757-bf0e-2da15a81de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:33.765136 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ab1ffb1a-9422-4757-bf0e-2da15a81de6f None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:33.769670 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ab1ffb1a-9422-4757-bf0e-2da15a81de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:33.775222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1402/2772] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:33.779708 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf202f63-3e68-4e8e-8c37-0118a391c2ce None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:33.790436 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf202f63-3e68-4e8e-8c37-0118a391c2ce None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:33.795310 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68fe2b-b408-4e12-96a3-dada1b5eff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:33.795946 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68fe2b-b408-4e12-96a3-dada1b5eff28 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:33.796231 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68fe2b-b408-4e12-96a3-dada1b5eff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:33.796496 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68fe2b-b408-4e12-96a3-dada1b5eff28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:33.797297 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68fe2b-b408-4e12-96a3-dada1b5eff28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:31:33.797630 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68fe2b-b408-4e12-96a3-dada1b5eff28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:33.799470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68fe2b-b408-4e12-96a3-dada1b5eff28 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:33.812764 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1371/2773] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:31:33.817436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ffb1a-9422-4757-bf0e-2da15a81de6f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:33.826805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ffb1a-9422-4757-bf0e-2da15a81de6f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:33.832668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19128b5-f478-41a5-a64f-aecffcafccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:33.839578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19128b5-f478-41a5-a64f-aecffcafccf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:33.839578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19128b5-f478-41a5-a64f-aecffcafccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:33.839578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19128b5-f478-41a5-a64f-aecffcafccf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:33.839578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19128b5-f478-41a5-a64f-aecffcafccf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:33.839578 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19128b5-f478-41a5-a64f-aecffcafccf8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:33.918365 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1403/2774] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:31:33 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:31:33.922729 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68fe2b-b408-4e12-96a3-dada1b5eff28 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:33.930169 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:33.934225 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68fe2b-b408-4e12-96a3-dada1b5eff28 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:34.000902 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ebe94-94cf-48d9-9c65-f6d4beac831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:34.002025 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ebe94-94cf-48d9-9c65-f6d4beac831b admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:34.002025 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ebe94-94cf-48d9-9c65-f6d4beac831b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:34.002427 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ebe94-94cf-48d9-9c65-f6d4beac831b admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:34.003075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ebe94-94cf-48d9-9c65-f6d4beac831b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:34.005042 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ebe94-94cf-48d9-9c65-f6d4beac831b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:34.080706 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1372/2775] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:31:33 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:31:34.085352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19128b5-f478-41a5-a64f-aecffcafccf8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:34.096763 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19128b5-f478-41a5-a64f-aecffcafccf8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:34.102312 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57757771-ce51-480c-9da2-232b453c135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:34.103341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57757771-ce51-480c-9da2-232b453c135c admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:34.103676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57757771-ce51-480c-9da2-232b453c135c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:34.115878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57757771-ce51-480c-9da2-232b453c135c admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:34.115878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57757771-ce51-480c-9da2-232b453c135c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:34.115878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57757771-ce51-480c-9da2-232b453c135c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:34.118899 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1404/2776] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:31:34.123228 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ebe94-94cf-48d9-9c65-f6d4beac831b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:34.134866 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ebe94-94cf-48d9-9c65-f6d4beac831b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:34.140173 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9951a3-e669-436d-9d7a-ce227c55a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:34.143512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9951a3-e669-436d-9d7a-ce227c55a962 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:34.143512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9951a3-e669-436d-9d7a-ce227c55a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:34.143512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9951a3-e669-436d-9d7a-ce227c55a962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:34.143512 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9951a3-e669-436d-9d7a-ce227c55a962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:34.143891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9951a3-e669-436d-9d7a-ce227c55a962 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:34.154675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1373/2777] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:31:34.159706 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57757771-ce51-480c-9da2-232b453c135c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:34.169875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57757771-ce51-480c-9da2-232b453c135c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:34.175599 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1334c2-3c07-4311-81dd-27af7790f105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:34.176364 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1334c2-3c07-4311-81dd-27af7790f105 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:34.176702 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1334c2-3c07-4311-81dd-27af7790f105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:34.177056 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1334c2-3c07-4311-81dd-27af7790f105 admin admin] PATH_INFO: `/v3/projects/49385dc91786483c887a90d1bef39f82/users/b5ad3cfb619b4f24872826f98cc677ad/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:34.193341 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1334c2-3c07-4311-81dd-27af7790f105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49385dc91786483c887a90d1bef39f82, user_id=b5ad3cfb619b4f24872826f98cc677ad, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:34.196034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1334c2-3c07-4311-81dd-27af7790f105 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:34.261420 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1405/2778] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:31:34 2022] PUT /identity/v3/projects/49385dc91786483c887a90d1bef39f82/users/b5ad3cfb619b4f24872826f98cc677ad/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:34.272583 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29919038-320d-406e-91da-19a88d797b35 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:34.272931 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29919038-320d-406e-91da-19a88d797b35 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:34.273208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29919038-320d-406e-91da-19a88d797b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:34.304632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-29919038-320d-406e-91da-19a88d797b35 None None] MFA Rules not processed for user `b5ad3cfb619b4f24872826f98cc677ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:34.306035 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-29919038-320d-406e-91da-19a88d797b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:34.398894 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1374/2779] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:34.410658 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1334c2-3c07-4311-81dd-27af7790f105 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:34.412407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1e1334c2-3c07-4311-81dd-27af7790f105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:34.425233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:34.521889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1334c2-3c07-4311-81dd-27af7790f105 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:34.526671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220858d-c58f-4cf9-a80f-c9901efdc81e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b8a5b38ac046ed8e8b98f0ecefb07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:34.527418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220858d-c58f-4cf9-a80f-c9901efdc81e service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:34.527700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220858d-c58f-4cf9-a80f-c9901efdc81e service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:34.527994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220858d-c58f-4cf9-a80f-c9901efdc81e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:34.538523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220858d-c58f-4cf9-a80f-c9901efdc81e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:34.540281 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220858d-c58f-4cf9-a80f-c9901efdc81e service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:34.553342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1406/2780] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:37.008363 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a531e-99e9-434c-a225-a3ab873e34be None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:37.008840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a531e-99e9-434c-a225-a3ab873e34be None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:37.008949 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a531e-99e9-434c-a225-a3ab873e34be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:37.040821 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-270a531e-99e9-434c-a225-a3ab873e34be None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:37.042116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-270a531e-99e9-434c-a225-a3ab873e34be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:37.108675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1375/2781] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:31:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:31:37.247224 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220858d-c58f-4cf9-a80f-c9901efdc81e service glance] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:37.248614 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e220858d-c58f-4cf9-a80f-c9901efdc81e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:37.318132 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220858d-c58f-4cf9-a80f-c9901efdc81e service glance] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:37.323152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a5896-3ed6-4e85-a54e-5be097c447c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:37.323754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a5896-3ed6-4e85-a54e-5be097c447c5 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:37.324031 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a5896-3ed6-4e85-a54e-5be097c447c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:37.324302 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a5896-3ed6-4e85-a54e-5be097c447c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:37.332560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a5896-3ed6-4e85-a54e-5be097c447c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:37.337922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a5896-3ed6-4e85-a54e-5be097c447c5 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:37.342212 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1407/2782] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:31:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:31:38.112663 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a7ee-9dab-4b04-aa87-fcb101aee12c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:38.118381 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a7ee-9dab-4b04-aa87-fcb101aee12c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:38.118930 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a7ee-9dab-4b04-aa87-fcb101aee12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:38.127147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:38.139365 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-abf7a7ee-9dab-4b04-aa87-fcb101aee12c None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:38.142613 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-abf7a7ee-9dab-4b04-aa87-fcb101aee12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:38.147928 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1376/2783] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 17 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:38.164353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a5896-3ed6-4e85-a54e-5be097c447c5 service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:38.176991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a5896-3ed6-4e85-a54e-5be097c447c5 service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:38.182298 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bf8f7-c4b7-425d-8ee7-5d65f97615de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:38.182929 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bf8f7-c4b7-425d-8ee7-5d65f97615de service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:38.183204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bf8f7-c4b7-425d-8ee7-5d65f97615de service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:38.183473 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bf8f7-c4b7-425d-8ee7-5d65f97615de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:38.191588 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bf8f7-c4b7-425d-8ee7-5d65f97615de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:38.194197 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bf8f7-c4b7-425d-8ee7-5d65f97615de service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:38.201087 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1408/2784] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:31:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:31:38.866192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b325d0-4d19-46e7-9756-5e4c647e0a7c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:38.866501 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b325d0-4d19-46e7-9756-5e4c647e0a7c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:38.866751 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b325d0-4d19-46e7-9756-5e4c647e0a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:38.889094 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-25b325d0-4d19-46e7-9756-5e4c647e0a7c None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:38.890662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-25b325d0-4d19-46e7-9756-5e4c647e0a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:38.906392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1377/2785] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:38.918811 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bf8f7-c4b7-425d-8ee7-5d65f97615de service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:38.930089 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bf8f7-c4b7-425d-8ee7-5d65f97615de service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:38.935095 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d14584-e2c5-4d80-827c-30946daa94d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:38.935689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d14584-e2c5-4d80-827c-30946daa94d7 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:38.935966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d14584-e2c5-4d80-827c-30946daa94d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:38.936238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d14584-e2c5-4d80-827c-30946daa94d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:38.944949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d14584-e2c5-4d80-827c-30946daa94d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:38.946639 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d14584-e2c5-4d80-827c-30946daa94d7 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:38.954883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1409/2786] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:31:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:31:39.553004 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd80b6-c290-4da7-ad80-295c12952a7f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:39.553544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd80b6-c290-4da7-ad80-295c12952a7f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:39.553646 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd80b6-c290-4da7-ad80-295c12952a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:39.573492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3abd80b6-c290-4da7-ad80-295c12952a7f None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:39.574769 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3abd80b6-c290-4da7-ad80-295c12952a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:39.582970 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1378/2787] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 17 16:31:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:39.596537 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d14584-e2c5-4d80-827c-30946daa94d7 service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:39.608248 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d14584-e2c5-4d80-827c-30946daa94d7 service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:39.613509 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0185cb0-bae3-43b9-aa72-c52c71b8a55c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:39.614115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0185cb0-bae3-43b9-aa72-c52c71b8a55c service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:39.614416 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0185cb0-bae3-43b9-aa72-c52c71b8a55c service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:39.614688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0185cb0-bae3-43b9-aa72-c52c71b8a55c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:39.623163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0185cb0-bae3-43b9-aa72-c52c71b8a55c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:39.624889 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0185cb0-bae3-43b9-aa72-c52c71b8a55c service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:39.634067 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1410/2788] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:31:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:31:42.446917 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd80b6-c290-4da7-ad80-295c12952a7f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:42.448356 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3abd80b6-c290-4da7-ad80-295c12952a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:42.526564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd80b6-c290-4da7-ad80-295c12952a7f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:42.531270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:42.531956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:42.532235 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:42.532508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] PATH_INFO: `/v3/users/d459e8294d3e406c9b1a7b89932a3d80` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:42.534298 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d459e8294d3e406c9b1a7b89932a3d80)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:42.538715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:42.739805 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd459e8294d3e406c9b1a7b89932a3d80'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:42.740452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd459e8294d3e406c9b1a7b89932a3d80'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:42.747447 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd459e8294d3e406c9b1a7b89932a3d80'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:42.761017 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd459e8294d3e406c9b1a7b89932a3d80'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:42.846775 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd459e8294d3e406c9b1a7b89932a3d80'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:42.853179 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1379/2789] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:31:42 2022] DELETE /identity/v3/users/d459e8294d3e406c9b1a7b89932a3d80 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:42.857700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413a851-c097-4d83-a19f-e919b1f01977 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:42.861545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413a851-c097-4d83-a19f-e919b1f01977 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:42.861545 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413a851-c097-4d83-a19f-e919b1f01977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:42.878092 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f413a851-c097-4d83-a19f-e919b1f01977 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:42.879349 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f413a851-c097-4d83-a19f-e919b1f01977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:42.942709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:42.959949 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1411/2790] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:42.969749 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:42.971319 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:43.035009 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f743e-659e-4205-95bb-36f44ee0765a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:43.038503 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcb603-d00d-468e-99c9-98c42bc3b7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:43.039095 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcb603-d00d-468e-99c9-98c42bc3b7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:43.039369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcb603-d00d-468e-99c9-98c42bc3b7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:43.039632 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcb603-d00d-468e-99c9-98c42bc3b7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:43.049080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcb603-d00d-468e-99c9-98c42bc3b7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:43.050952 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcb603-d00d-468e-99c9-98c42bc3b7e6 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:43.064959 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1380/2791] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:43.329555 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413a851-c097-4d83-a19f-e919b1f01977 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:43.331789 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f413a851-c097-4d83-a19f-e919b1f01977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:43.346546 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413a851-c097-4d83-a19f-e919b1f01977 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:43.352569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:43.353727 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:43.354010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:43.354485 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] PATH_INFO: `/v3/projects/97810b4d2acd4ecbbec6e2fee456ed04` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:43.355759 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97810b4d2acd4ecbbec6e2fee456ed04)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:43.357675 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:43.490357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97810b4d2acd4ecbbec6e2fee456ed04', 'request_id': 'req-9fcd1274-246d-480a-ba55-5d80ba578d84'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:43.496373 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97810b4d2acd4ecbbec6e2fee456ed04', 'request_id': 'req-9fcd1274-246d-480a-ba55-5d80ba578d84'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:43.503306 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97810b4d2acd4ecbbec6e2fee456ed04', 'request_id': 'req-9fcd1274-246d-480a-ba55-5d80ba578d84'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:43.578892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] The token cache is being invalidate because project 97810b4d2acd4ecbbec6e2fee456ed04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:31:43.579163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:43.580333 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9fcd1274-246d-480a-ba55-5d80ba578d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:43.582531 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1412/2792] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:31:43 2022] DELETE /identity/v3/projects/97810b4d2acd4ecbbec6e2fee456ed04 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:44.718717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcb603-d00d-468e-99c9-98c42bc3b7e6 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:44.720229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-83bcb603-d00d-468e-99c9-98c42bc3b7e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:44.725847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:44.818981 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcb603-d00d-468e-99c9-98c42bc3b7e6 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:44.884922 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cd3d0-0939-414a-bda7-28ea3a565c14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da5e1da2196b4ff399921809f40d3002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:44.885717 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cd3d0-0939-414a-bda7-28ea3a565c14 service placement] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:44.886097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cd3d0-0939-414a-bda7-28ea3a565c14 service placement] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:44.886488 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cd3d0-0939-414a-bda7-28ea3a565c14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:44.888950 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0d0cd3d0-0939-414a-bda7-28ea3a565c14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:44.904005 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cd3d0-0939-414a-bda7-28ea3a565c14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:44.905270 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cd3d0-0939-414a-bda7-28ea3a565c14 service placement] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:44.918679 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1381/2793] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:50.366272 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee792b1-7c65-4079-a4ca-d4fb4160f8ee None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:50.366741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee792b1-7c65-4079-a4ca-d4fb4160f8ee None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:50.366837 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee792b1-7c65-4079-a4ca-d4fb4160f8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:50.386518 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cee792b1-7c65-4079-a4ca-d4fb4160f8ee None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:50.388143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cee792b1-7c65-4079-a4ca-d4fb4160f8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:50.443830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1413/2794] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:31:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:50.457163 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cd3d0-0939-414a-bda7-28ea3a565c14 service placement] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:50.459265 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0d0cd3d0-0939-414a-bda7-28ea3a565c14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:50.527254 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cd3d0-0939-414a-bda7-28ea3a565c14 service placement] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:50.532331 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0daf4d-bb6e-40c2-bc95-20ad0006b361 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:50.532937 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0daf4d-bb6e-40c2-bc95-20ad0006b361 service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:50.533214 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0daf4d-bb6e-40c2-bc95-20ad0006b361 service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:50.533517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0daf4d-bb6e-40c2-bc95-20ad0006b361 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:50.542515 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0daf4d-bb6e-40c2-bc95-20ad0006b361 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:50.544097 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0daf4d-bb6e-40c2-bc95-20ad0006b361 service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:50.552248 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1382/2795] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:31:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:31:50.853078 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee792b1-7c65-4079-a4ca-d4fb4160f8ee None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:50.854839 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cee792b1-7c65-4079-a4ca-d4fb4160f8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:50.944256 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee792b1-7c65-4079-a4ca-d4fb4160f8ee None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:50.951185 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:50.951961 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:50.952358 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:50.952772 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] PATH_INFO: `/v3/users/b5ad3cfb619b4f24872826f98cc677ad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:50.954044 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ad3cfb619b4f24872826f98cc677ad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:50.956047 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:50.978781 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:51.162558 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ad3cfb619b4f24872826f98cc677ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:51.163034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ad3cfb619b4f24872826f98cc677ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:51.179449 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ad3cfb619b4f24872826f98cc677ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:51.187405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ad3cfb619b4f24872826f98cc677ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:51.187405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ad3cfb619b4f24872826f98cc677ad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:51.271237 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1414/2796] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:31:50 2022] DELETE /identity/v3/users/b5ad3cfb619b4f24872826f98cc677ad => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:51.277665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f8149-db90-4193-bdea-63b10a89e43d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:51.278694 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f8149-db90-4193-bdea-63b10a89e43d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:51.279092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f8149-db90-4193-bdea-63b10a89e43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:51.293106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:51.301340 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-238f8149-db90-4193-bdea-63b10a89e43d None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:51.303541 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-238f8149-db90-4193-bdea-63b10a89e43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:51.378840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1383/2797] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:51.391121 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:51.393075 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:51.487101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b471483-6197-4f72-a504-d16398fec6bd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:51.491489 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbd225-3131-4841-9334-4006822512b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:51.492190 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd225-3131-4841-9334-4006822512b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:51.492560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd225-3131-4841-9334-4006822512b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:51.492983 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd225-3131-4841-9334-4006822512b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:51.503657 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbd225-3131-4841-9334-4006822512b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:51.505848 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbd225-3131-4841-9334-4006822512b5 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:51.519729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1415/2798] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:51.957211 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f8149-db90-4193-bdea-63b10a89e43d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:51.959654 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-238f8149-db90-4193-bdea-63b10a89e43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:51.981430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f8149-db90-4193-bdea-63b10a89e43d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:51.981430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:51.981430 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:51.985587 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:51.985867 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] PATH_INFO: `/v3/projects/49385dc91786483c887a90d1bef39f82` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:51.987141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49385dc91786483c887a90d1bef39f82)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:51.989133 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:52.108402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49385dc91786483c887a90d1bef39f82', 'request_id': 'req-61e8cad9-ca07-4bdf-9752-aaf67748918f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:52.115740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49385dc91786483c887a90d1bef39f82', 'request_id': 'req-61e8cad9-ca07-4bdf-9752-aaf67748918f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:52.155785 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49385dc91786483c887a90d1bef39f82', 'request_id': 'req-61e8cad9-ca07-4bdf-9752-aaf67748918f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:52.168982 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] The token cache is being invalidate because project 49385dc91786483c887a90d1bef39f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:31:52.169633 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:52.170409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-61e8cad9-ca07-4bdf-9752-aaf67748918f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:52.172027 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1384/2799] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:31:51 2022] DELETE /identity/v3/projects/49385dc91786483c887a90d1bef39f82 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:52.178173 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb7a5-7445-4c66-a7f9-8cc7e157ced6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:52.178769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb7a5-7445-4c66-a7f9-8cc7e157ced6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:52.179528 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb7a5-7445-4c66-a7f9-8cc7e157ced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:52.201391 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8f0bb7a5-7445-4c66-a7f9-8cc7e157ced6 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:52.202622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8f0bb7a5-7445-4c66-a7f9-8cc7e157ced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:52.276362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1416/2800] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:52.285395 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43a3c8-a2df-4153-9cce-503c87c162cb None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:52.285686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43a3c8-a2df-4153-9cce-503c87c162cb None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:52.285958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43a3c8-a2df-4153-9cce-503c87c162cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:52.309618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5e43a3c8-a2df-4153-9cce-503c87c162cb None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:52.310868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5e43a3c8-a2df-4153-9cce-503c87c162cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:52.321405 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1385/2801] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:31:52.324729 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bb7a5-7445-4c66-a7f9-8cc7e157ced6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:52.336143 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bb7a5-7445-4c66-a7f9-8cc7e157ced6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:52.341641 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2a8e6-3df3-4451-831c-3d141659a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:52.342336 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a8e6-3df3-4451-831c-3d141659a4eb admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:52.342677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a8e6-3df3-4451-831c-3d141659a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:52.343023 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a8e6-3df3-4451-831c-3d141659a4eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:52.343807 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2a8e6-3df3-4451-831c-3d141659a4eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:31:52.344180 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2a8e6-3df3-4451-831c-3d141659a4eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:52.345830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2a8e6-3df3-4451-831c-3d141659a4eb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:52.364200 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1417/2802] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:31:52.367256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43a3c8-a2df-4153-9cce-503c87c162cb None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:52.377934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43a3c8-a2df-4153-9cce-503c87c162cb None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:52.383301 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d710c-2f24-43ea-a0de-c09309460c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:52.383921 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d710c-2f24-43ea-a0de-c09309460c88 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:52.384200 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d710c-2f24-43ea-a0de-c09309460c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:52.384470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d710c-2f24-43ea-a0de-c09309460c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:52.385101 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d710c-2f24-43ea-a0de-c09309460c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:52.387862 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d710c-2f24-43ea-a0de-c09309460c88 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:52.484553 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1386/2803] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:31:52 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:31:52.489064 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2a8e6-3df3-4451-831c-3d141659a4eb admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:52.499731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:52.505424 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2a8e6-3df3-4451-831c-3d141659a4eb admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:52.579010 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cad43-b667-4299-ba97-deff269b5e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:52.579501 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cad43-b667-4299-ba97-deff269b5e32 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:52.579786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cad43-b667-4299-ba97-deff269b5e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:52.581719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cad43-b667-4299-ba97-deff269b5e32 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:52.581719 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cad43-b667-4299-ba97-deff269b5e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:52.583271 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cad43-b667-4299-ba97-deff269b5e32 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:52.660375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1418/2804] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:31:52 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:31:52.666840 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d710c-2f24-43ea-a0de-c09309460c88 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:52.678783 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d710c-2f24-43ea-a0de-c09309460c88 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:52.683618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98286a1e-1a1a-463c-9fb2-a5955b7ca2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:52.684308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98286a1e-1a1a-463c-9fb2-a5955b7ca2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:52.684655 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98286a1e-1a1a-463c-9fb2-a5955b7ca2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:52.684993 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98286a1e-1a1a-463c-9fb2-a5955b7ca2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:52.685762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98286a1e-1a1a-463c-9fb2-a5955b7ca2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:52.687659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98286a1e-1a1a-463c-9fb2-a5955b7ca2d3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:52.702517 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1387/2805] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:31:52.703522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cad43-b667-4299-ba97-deff269b5e32 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:52.715012 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cad43-b667-4299-ba97-deff269b5e32 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:52.719855 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123d89a-4609-4571-810b-0801093e865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:52.720462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d89a-4609-4571-810b-0801093e865b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:52.720741 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d89a-4609-4571-810b-0801093e865b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:52.721016 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d89a-4609-4571-810b-0801093e865b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:52.721700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123d89a-4609-4571-810b-0801093e865b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:52.723307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123d89a-4609-4571-810b-0801093e865b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:52.737780 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1419/2806] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:31:52.738901 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98286a1e-1a1a-463c-9fb2-a5955b7ca2d3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:52.749865 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98286a1e-1a1a-463c-9fb2-a5955b7ca2d3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:52.754835 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027636a-3bf4-4c08-a57d-469f90326c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:52.755920 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027636a-3bf4-4c08-a57d-469f90326c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:52.756268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027636a-3bf4-4c08-a57d-469f90326c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:52.756516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027636a-3bf4-4c08-a57d-469f90326c6d admin admin] PATH_INFO: `/v3/projects/4a882adc4ab6420e9abc13d5ca66042f/users/cc2fb79c0c7349c29a0860f583b7c432/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:52.774285 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027636a-3bf4-4c08-a57d-469f90326c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a882adc4ab6420e9abc13d5ca66042f, user_id=cc2fb79c0c7349c29a0860f583b7c432, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:52.776979 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027636a-3bf4-4c08-a57d-469f90326c6d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:52.849564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1388/2807] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:31:52 2022] PUT /identity/v3/projects/4a882adc4ab6420e9abc13d5ca66042f/users/cc2fb79c0c7349c29a0860f583b7c432/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:31:52.859941 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c719-5845-4d2e-8cd5-6a489bde94ca None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:52.860233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c719-5845-4d2e-8cd5-6a489bde94ca None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:52.860532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c719-5845-4d2e-8cd5-6a489bde94ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:52.909688 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7bb5c719-5845-4d2e-8cd5-6a489bde94ca None None] MFA Rules not processed for user `cc2fb79c0c7349c29a0860f583b7c432`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:52.911051 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7bb5c719-5845-4d2e-8cd5-6a489bde94ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:53.010884 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1420/2808] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:53.015656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027636a-3bf4-4c08-a57d-469f90326c6d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:53.054908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:53.106582 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027636a-3bf4-4c08-a57d-469f90326c6d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:53.110634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0830db-5d05-4a35-8f92-85d29bb67d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:53.111257 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0830db-5d05-4a35-8f92-85d29bb67d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:53.111531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0830db-5d05-4a35-8f92-85d29bb67d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:53.111803 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0830db-5d05-4a35-8f92-85d29bb67d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:53.112423 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0830db-5d05-4a35-8f92-85d29bb67d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:53.115753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0830db-5d05-4a35-8f92-85d29bb67d87 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:53.229953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1389/2809] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:31:53 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:31:53.234666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5c719-5845-4d2e-8cd5-6a489bde94ca None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:53.257141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5c719-5845-4d2e-8cd5-6a489bde94ca None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:53.338374 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784371d4-2923-4963-ac07-e602e35d87f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:53.339055 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784371d4-2923-4963-ac07-e602e35d87f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:53.339350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784371d4-2923-4963-ac07-e602e35d87f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:53.339596 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784371d4-2923-4963-ac07-e602e35d87f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:53.340259 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784371d4-2923-4963-ac07-e602e35d87f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:53.342342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784371d4-2923-4963-ac07-e602e35d87f9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:53.666744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1421/2810] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:31:53 2022] POST /identity/v3/users => generated 292 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:31:53.671460 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0830db-5d05-4a35-8f92-85d29bb67d87 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:53.683508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0830db-5d05-4a35-8f92-85d29bb67d87 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:53.689770 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b084019-f580-4846-9a0e-4142703641d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:53.690475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b084019-f580-4846-9a0e-4142703641d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:53.690756 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b084019-f580-4846-9a0e-4142703641d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:53.691028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b084019-f580-4846-9a0e-4142703641d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:53.691683 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b084019-f580-4846-9a0e-4142703641d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:53.693801 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b084019-f580-4846-9a0e-4142703641d9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:53.705017 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1390/2811] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:31:53.716022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784371d4-2923-4963-ac07-e602e35d87f9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:53.721488 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:53.728413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784371d4-2923-4963-ac07-e602e35d87f9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:53.734138 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc6635-bfed-49a1-9ab6-25f47095edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:53.734760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc6635-bfed-49a1-9ab6-25f47095edb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:53.735034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc6635-bfed-49a1-9ab6-25f47095edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:53.735798 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc6635-bfed-49a1-9ab6-25f47095edb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:53.736028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc6635-bfed-49a1-9ab6-25f47095edb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:53.737931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc6635-bfed-49a1-9ab6-25f47095edb0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:53.752742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1422/2812] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:31:53.757111 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b084019-f580-4846-9a0e-4142703641d9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:53.785116 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b084019-f580-4846-9a0e-4142703641d9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:53.794426 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345b6af-d5e3-471d-ac54-494276d6f3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:53.795182 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345b6af-d5e3-471d-ac54-494276d6f3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:53.795455 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345b6af-d5e3-471d-ac54-494276d6f3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:53.795723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345b6af-d5e3-471d-ac54-494276d6f3f9 admin admin] PATH_INFO: `/v3/projects/ad85668bbc8747b9b95d62223132ae44/users/053f551c26a84d70865594d50050c492/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:53.821511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345b6af-d5e3-471d-ac54-494276d6f3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad85668bbc8747b9b95d62223132ae44, user_id=053f551c26a84d70865594d50050c492, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:53.824983 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345b6af-d5e3-471d-ac54-494276d6f3f9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:53.927672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1391/2813] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:31:53 2022] PUT /identity/v3/projects/ad85668bbc8747b9b95d62223132ae44/users/053f551c26a84d70865594d50050c492/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:53.938955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e578a41-02d9-47a4-ace4-adb0b897ad33 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:53.939580 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e578a41-02d9-47a4-ace4-adb0b897ad33 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:53.939861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e578a41-02d9-47a4-ace4-adb0b897ad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:53.978640 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3e578a41-02d9-47a4-ace4-adb0b897ad33 None None] MFA Rules not processed for user `053f551c26a84d70865594d50050c492`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:53.980282 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3e578a41-02d9-47a4-ace4-adb0b897ad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:54.069661 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1423/2814] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:54.072980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345b6af-d5e3-471d-ac54-494276d6f3f9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:54.158296 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345b6af-d5e3-471d-ac54-494276d6f3f9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:54.165251 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291e056-1352-4755-9c56-eab0b197cff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:54.166417 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291e056-1352-4755-9c56-eab0b197cff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:54.166706 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291e056-1352-4755-9c56-eab0b197cff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:54.166980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291e056-1352-4755-9c56-eab0b197cff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:54.167908 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291e056-1352-4755-9c56-eab0b197cff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:54.170516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291e056-1352-4755-9c56-eab0b197cff7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:54.271164 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1392/2815] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:31:54 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:31:54.272357 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e578a41-02d9-47a4-ace4-adb0b897ad33 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:54.284330 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e578a41-02d9-47a4-ace4-adb0b897ad33 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:54.356474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b89bb4-647e-46ac-88e0-95a1dde61971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:54.357257 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89bb4-647e-46ac-88e0-95a1dde61971 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:54.357586 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89bb4-647e-46ac-88e0-95a1dde61971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:54.357874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89bb4-647e-46ac-88e0-95a1dde61971 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:54.358524 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b89bb4-647e-46ac-88e0-95a1dde61971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:54.360793 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b89bb4-647e-46ac-88e0-95a1dde61971 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:54.432761 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1424/2816] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:31:54 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:31:54.436853 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291e056-1352-4755-9c56-eab0b197cff7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:54.450139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291e056-1352-4755-9c56-eab0b197cff7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:54.455616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e86461-855d-449b-9c07-995c8c4f92c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:54.456290 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86461-855d-449b-9c07-995c8c4f92c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:54.456738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86461-855d-449b-9c07-995c8c4f92c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:54.456738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86461-855d-449b-9c07-995c8c4f92c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:54.457429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e86461-855d-449b-9c07-995c8c4f92c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:54.459300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e86461-855d-449b-9c07-995c8c4f92c6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:54.474768 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1393/2817] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:31:54.478648 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b89bb4-647e-46ac-88e0-95a1dde61971 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:54.491125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b89bb4-647e-46ac-88e0-95a1dde61971 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:54.496760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb9f39-e8e2-4bf8-b633-f13ef15a911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:54.497532 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb9f39-e8e2-4bf8-b633-f13ef15a911e admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:54.497825 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb9f39-e8e2-4bf8-b633-f13ef15a911e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:54.498204 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb9f39-e8e2-4bf8-b633-f13ef15a911e admin admin] PATH_INFO: `/v3/projects/cf6617bee13c4f0995d32d506f33a25d/users/5e58fbde9d634a5ba43731e1969a8f0e/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:54.517324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb9f39-e8e2-4bf8-b633-f13ef15a911e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6617bee13c4f0995d32d506f33a25d, user_id=5e58fbde9d634a5ba43731e1969a8f0e, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:54.520090 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb9f39-e8e2-4bf8-b633-f13ef15a911e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:54.573755 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1425/2818] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:31:54 2022] PUT /identity/v3/projects/cf6617bee13c4f0995d32d506f33a25d/users/5e58fbde9d634a5ba43731e1969a8f0e/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:54.577956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e86461-855d-449b-9c07-995c8c4f92c6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:54.589905 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e86461-855d-449b-9c07-995c8c4f92c6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:54.668217 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:54.680588 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab159-9f3e-4258-b12c-0a832b618545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:54.681385 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab159-9f3e-4258-b12c-0a832b618545 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:54.681846 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab159-9f3e-4258-b12c-0a832b618545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:54.682209 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab159-9f3e-4258-b12c-0a832b618545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:54.682980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aab159-9f3e-4258-b12c-0a832b618545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:54.685006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aab159-9f3e-4258-b12c-0a832b618545 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:54.699529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1394/2819] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:31:54.701393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb9f39-e8e2-4bf8-b633-f13ef15a911e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:54.712413 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb9f39-e8e2-4bf8-b633-f13ef15a911e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:54.718004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b08d06-7e0c-4b22-bca8-ee4467490714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:54.718853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b08d06-7e0c-4b22-bca8-ee4467490714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:54.719239 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b08d06-7e0c-4b22-bca8-ee4467490714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:54.719576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b08d06-7e0c-4b22-bca8-ee4467490714 admin admin] PATH_INFO: `/v3/projects/cf6617bee13c4f0995d32d506f33a25d/users/5e58fbde9d634a5ba43731e1969a8f0e/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:54.721721 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b08d06-7e0c-4b22-bca8-ee4467490714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6617bee13c4f0995d32d506f33a25d, user_id=5e58fbde9d634a5ba43731e1969a8f0e, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:54.725342 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b08d06-7e0c-4b22-bca8-ee4467490714 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:54.738088 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1426/2820] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:31:54 2022] PUT /identity/v3/projects/cf6617bee13c4f0995d32d506f33a25d/users/5e58fbde9d634a5ba43731e1969a8f0e/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:31:54.811044 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c69686-1790-4feb-b7f4-dedff945ba2c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:54.811444 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c69686-1790-4feb-b7f4-dedff945ba2c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:54.811798 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c69686-1790-4feb-b7f4-dedff945ba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:54.845013 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f2c69686-1790-4feb-b7f4-dedff945ba2c None None] MFA Rules not processed for user `5e58fbde9d634a5ba43731e1969a8f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:31:54.846395 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f2c69686-1790-4feb-b7f4-dedff945ba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:54.933704 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1395/2821] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:31:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:31:54.946486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b08d06-7e0c-4b22-bca8-ee4467490714 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:54.948388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c2b08d06-7e0c-4b22-bca8-ee4467490714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:54.991458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:55.017040 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b08d06-7e0c-4b22-bca8-ee4467490714 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:55.022152 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d450b54-b533-4c2a-b0eb-bfdedb88f5ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:55.023327 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d450b54-b533-4c2a-b0eb-bfdedb88f5ae service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:55.023771 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d450b54-b533-4c2a-b0eb-bfdedb88f5ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:55.029538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d450b54-b533-4c2a-b0eb-bfdedb88f5ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:55.097346 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d450b54-b533-4c2a-b0eb-bfdedb88f5ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:55.098861 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d450b54-b533-4c2a-b0eb-bfdedb88f5ae service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:55.109028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1427/2822] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:57.212190 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c69686-1790-4feb-b7f4-dedff945ba2c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:57.213941 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f2c69686-1790-4feb-b7f4-dedff945ba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:57.227046 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c69686-1790-4feb-b7f4-dedff945ba2c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:57.231003 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67fbf8-421d-4c4e-9682-0950afbddede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:57.231631 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67fbf8-421d-4c4e-9682-0950afbddede service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:57.231912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67fbf8-421d-4c4e-9682-0950afbddede service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:57.232203 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67fbf8-421d-4c4e-9682-0950afbddede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:57.316214 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67fbf8-421d-4c4e-9682-0950afbddede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:57.318635 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67fbf8-421d-4c4e-9682-0950afbddede service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:57.331513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1396/2823] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:58.838600 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d450b54-b533-4c2a-b0eb-bfdedb88f5ae service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:58.858577 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d450b54-b533-4c2a-b0eb-bfdedb88f5ae service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:58.862786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dc686-9667-48c4-bc57-91f94a64544c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:58.862786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dc686-9667-48c4-bc57-91f94a64544c service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:58.863091 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dc686-9667-48c4-bc57-91f94a64544c service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:58.863352 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dc686-9667-48c4-bc57-91f94a64544c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:58.874743 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dc686-9667-48c4-bc57-91f94a64544c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:58.876878 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dc686-9667-48c4-bc57-91f94a64544c service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:58.899353 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1428/2824] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:32:03.667392 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67fbf8-421d-4c4e-9682-0950afbddede service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:03.742304 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67fbf8-421d-4c4e-9682-0950afbddede service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:03.749149 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:03.750968 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:03.751413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:03.751868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] PATH_INFO: `/v3/users/cc2fb79c0c7349c29a0860f583b7c432` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:03.753256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2fb79c0c7349c29a0860f583b7c432)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:03.755576 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:03.773523 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:03.951766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2fb79c0c7349c29a0860f583b7c432'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:03.953124 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2fb79c0c7349c29a0860f583b7c432'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:03.964527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2fb79c0c7349c29a0860f583b7c432'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:03.981308 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2fb79c0c7349c29a0860f583b7c432'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:04.063575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2fb79c0c7349c29a0860f583b7c432'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:04.071642 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1397/2825] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:32:03 2022] DELETE /identity/v3/users/cc2fb79c0c7349c29a0860f583b7c432 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:04.076732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb4bce-a3ac-4593-a759-653f9f26b9a3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:04.080679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb4bce-a3ac-4593-a759-653f9f26b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:04.080679 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb4bce-a3ac-4593-a759-653f9f26b9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:04.103883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2efb4bce-a3ac-4593-a759-653f9f26b9a3 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:04.105034 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2efb4bce-a3ac-4593-a759-653f9f26b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:04.170028 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1429/2826] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:04.181098 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:04.182560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:04.251477 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c1594-47c7-4128-b12e-aedeb504e13a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:04.263918 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e3b81-64b1-4199-907d-0cd6fa49b73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:04.264621 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3b81-64b1-4199-907d-0cd6fa49b73e service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:04.265015 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3b81-64b1-4199-907d-0cd6fa49b73e service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:04.265144 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3b81-64b1-4199-907d-0cd6fa49b73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:04.276073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e3b81-64b1-4199-907d-0cd6fa49b73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:04.281452 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e3b81-64b1-4199-907d-0cd6fa49b73e service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:04.289719 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1398/2827] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:32:04.712407 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb4bce-a3ac-4593-a759-653f9f26b9a3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:04.714379 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2efb4bce-a3ac-4593-a759-653f9f26b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:04.757419 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb4bce-a3ac-4593-a759-653f9f26b9a3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:04.767236 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:04.768018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:04.768502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:04.768629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] PATH_INFO: `/v3/projects/4a882adc4ab6420e9abc13d5ca66042f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:04.772329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a882adc4ab6420e9abc13d5ca66042f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:04.774769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:04.925506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a882adc4ab6420e9abc13d5ca66042f', 'request_id': 'req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:04.933642 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a882adc4ab6420e9abc13d5ca66042f', 'request_id': 'req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:04.937166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:04.946284 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a882adc4ab6420e9abc13d5ca66042f', 'request_id': 'req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:05.023892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] The token cache is being invalidate because project 4a882adc4ab6420e9abc13d5ca66042f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:32:05.024339 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:05.025252 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:05.027744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1430/2828] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:32:04 2022] DELETE /identity/v3/projects/4a882adc4ab6420e9abc13d5ca66042f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:05.031653 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e3b81-64b1-4199-907d-0cd6fa49b73e service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:05.044680 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e3b81-64b1-4199-907d-0cd6fa49b73e service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:05.124077 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:05.124842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:05.125183 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:05.125620 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] PATH_INFO: `/v3/users/053f551c26a84d70865594d50050c492` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:05.126926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=053f551c26a84d70865594d50050c492)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:05.129240 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:05.296395 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:05.310139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053f551c26a84d70865594d50050c492'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:05.310891 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053f551c26a84d70865594d50050c492'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:05.319344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053f551c26a84d70865594d50050c492'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:05.332972 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053f551c26a84d70865594d50050c492'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:05.406568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053f551c26a84d70865594d50050c492'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:05.413854 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1399/2829] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:32:05 2022] DELETE /identity/v3/users/053f551c26a84d70865594d50050c492 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:05.895754 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:05.897734 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:05.915467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504e4ac-6d9a-4784-b1b9-d8e3686d87e0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:05.979843 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:05.980495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:05.980782 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:05.981057 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] PATH_INFO: `/v3/projects/ad85668bbc8747b9b95d62223132ae44` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:05.989666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad85668bbc8747b9b95d62223132ae44)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:05.996096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:06.100616 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad85668bbc8747b9b95d62223132ae44', 'request_id': 'req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:06.109660 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad85668bbc8747b9b95d62223132ae44', 'request_id': 'req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:06.118156 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad85668bbc8747b9b95d62223132ae44', 'request_id': 'req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:06.188536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] The token cache is being invalidate because project ad85668bbc8747b9b95d62223132ae44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:32:06.188842 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:06.189609 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:06.191902 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1431/2830] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:32:05 2022] DELETE /identity/v3/projects/ad85668bbc8747b9b95d62223132ae44 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:06.196416 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:06.198313 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:06.214470 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb1941-6d22-425d-82f3-eef69a435f6f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:06.295222 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae361286-111d-45d1-94e9-3a9fce696e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:06.296180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae361286-111d-45d1-94e9-3a9fce696e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:06.296545 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae361286-111d-45d1-94e9-3a9fce696e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:06.296878 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae361286-111d-45d1-94e9-3a9fce696e07 admin admin] PATH_INFO: `/v3/users/5e58fbde9d634a5ba43731e1969a8f0e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:06.302106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae361286-111d-45d1-94e9-3a9fce696e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e58fbde9d634a5ba43731e1969a8f0e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:06.304929 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae361286-111d-45d1-94e9-3a9fce696e07 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:06.484882 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ae361286-111d-45d1-94e9-3a9fce696e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e58fbde9d634a5ba43731e1969a8f0e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:06.485513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ae361286-111d-45d1-94e9-3a9fce696e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e58fbde9d634a5ba43731e1969a8f0e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:06.492953 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ae361286-111d-45d1-94e9-3a9fce696e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e58fbde9d634a5ba43731e1969a8f0e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:06.505947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ae361286-111d-45d1-94e9-3a9fce696e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e58fbde9d634a5ba43731e1969a8f0e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:06.565063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ae361286-111d-45d1-94e9-3a9fce696e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e58fbde9d634a5ba43731e1969a8f0e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:06.572971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1400/2831] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:32:06 2022] DELETE /identity/v3/users/5e58fbde9d634a5ba43731e1969a8f0e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:07.035886 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:07.037514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:07.050497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59309c-4a1f-4b78-b5c7-c795dc5834f2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:07.108192 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:07.108817 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:07.109096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:07.109386 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] PATH_INFO: `/v3/projects/cf6617bee13c4f0995d32d506f33a25d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:07.110500 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6617bee13c4f0995d32d506f33a25d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:07.112398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:07.135313 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:07.221188 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6617bee13c4f0995d32d506f33a25d', 'request_id': 'req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:07.227071 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6617bee13c4f0995d32d506f33a25d', 'request_id': 'req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:07.233309 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6617bee13c4f0995d32d506f33a25d', 'request_id': 'req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:07.342165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] The token cache is being invalidate because project cf6617bee13c4f0995d32d506f33a25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:32:07.342369 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:07.342991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-250e9ea8-d9cc-4f84-8cf5-f2671c7f7cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:07.344477 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1432/2832] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:32:07 2022] DELETE /identity/v3/projects/cf6617bee13c4f0995d32d506f33a25d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:07.351403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20caacc-96e2-46df-8e98-934cdc40b290 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:07.351940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20caacc-96e2-46df-8e98-934cdc40b290 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:07.351940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20caacc-96e2-46df-8e98-934cdc40b290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:07.371997 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b20caacc-96e2-46df-8e98-934cdc40b290 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:07.373204 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b20caacc-96e2-46df-8e98-934cdc40b290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:07.399073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:07.433040 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1401/2833] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:07.440441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef27bd1-6aaf-4a2a-839b-0830668d32bc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:07.440725 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef27bd1-6aaf-4a2a-839b-0830668d32bc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:07.441000 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef27bd1-6aaf-4a2a-839b-0830668d32bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:07.460590 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8ef27bd1-6aaf-4a2a-839b-0830668d32bc None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:07.461846 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8ef27bd1-6aaf-4a2a-839b-0830668d32bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:07.469731 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1433/2834] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:07.473911 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20caacc-96e2-46df-8e98-934cdc40b290 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:07.484039 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20caacc-96e2-46df-8e98-934cdc40b290 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:07.488691 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45670311-9d54-4e78-9a3c-9bf9cb154e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:07.489281 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45670311-9d54-4e78-9a3c-9bf9cb154e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:07.489600 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45670311-9d54-4e78-9a3c-9bf9cb154e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:07.489870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45670311-9d54-4e78-9a3c-9bf9cb154e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:07.491180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45670311-9d54-4e78-9a3c-9bf9cb154e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:32:07.491682 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45670311-9d54-4e78-9a3c-9bf9cb154e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:07.494007 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45670311-9d54-4e78-9a3c-9bf9cb154e0e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:07.505326 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1402/2835] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:32:07.509554 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef27bd1-6aaf-4a2a-839b-0830668d32bc None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:07.519001 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef27bd1-6aaf-4a2a-839b-0830668d32bc None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:07.523874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f004d8-733a-4fa4-867e-27f3bb719426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:07.524462 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f004d8-733a-4fa4-867e-27f3bb719426 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:07.524738 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f004d8-733a-4fa4-867e-27f3bb719426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:07.525007 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f004d8-733a-4fa4-867e-27f3bb719426 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:07.525671 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f004d8-733a-4fa4-867e-27f3bb719426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:07.527569 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f004d8-733a-4fa4-867e-27f3bb719426 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:07.607470 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1434/2836] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:32:07 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:32:07.611651 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45670311-9d54-4e78-9a3c-9bf9cb154e0e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:07.622740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45670311-9d54-4e78-9a3c-9bf9cb154e0e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:07.679152 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d25304-8294-40b2-9ed2-fc79e81afc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:07.679747 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d25304-8294-40b2-9ed2-fc79e81afc91 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:07.680022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d25304-8294-40b2-9ed2-fc79e81afc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:07.680295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d25304-8294-40b2-9ed2-fc79e81afc91 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:07.680934 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d25304-8294-40b2-9ed2-fc79e81afc91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:07.682863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d25304-8294-40b2-9ed2-fc79e81afc91 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:07.765966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1403/2837] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:32:07 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:32:07.770053 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f004d8-733a-4fa4-867e-27f3bb719426 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:07.781090 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f004d8-733a-4fa4-867e-27f3bb719426 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:07.785956 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653df7a-ac27-4055-8f3b-91ae5d520780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:07.786552 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653df7a-ac27-4055-8f3b-91ae5d520780 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:07.786827 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653df7a-ac27-4055-8f3b-91ae5d520780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:07.787726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653df7a-ac27-4055-8f3b-91ae5d520780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:07.788375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653df7a-ac27-4055-8f3b-91ae5d520780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:07.790018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653df7a-ac27-4055-8f3b-91ae5d520780 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:07.800025 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1435/2838] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:32:07.803958 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d25304-8294-40b2-9ed2-fc79e81afc91 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:07.814041 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d25304-8294-40b2-9ed2-fc79e81afc91 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:07.818763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167288e-14d9-464d-854a-3583eed5db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:07.819350 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167288e-14d9-464d-854a-3583eed5db58 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:07.819624 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167288e-14d9-464d-854a-3583eed5db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:07.819890 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167288e-14d9-464d-854a-3583eed5db58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:07.820515 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167288e-14d9-464d-854a-3583eed5db58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:07.822130 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167288e-14d9-464d-854a-3583eed5db58 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:07.833766 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1404/2839] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:32:07.838222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653df7a-ac27-4055-8f3b-91ae5d520780 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:07.848141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653df7a-ac27-4055-8f3b-91ae5d520780 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:07.853806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b12f0-c1ba-4fa9-a701-c500ff4ef2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:07.854458 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b12f0-c1ba-4fa9-a701-c500ff4ef2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:07.854733 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b12f0-c1ba-4fa9-a701-c500ff4ef2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:07.855003 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b12f0-c1ba-4fa9-a701-c500ff4ef2bc admin admin] PATH_INFO: `/v3/projects/7930c13738104074b0c0862ed7089836/users/6277ed3f96904606bdb5db8c495f0f38/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:07.869303 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b12f0-c1ba-4fa9-a701-c500ff4ef2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7930c13738104074b0c0862ed7089836, user_id=6277ed3f96904606bdb5db8c495f0f38, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:07.871900 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b12f0-c1ba-4fa9-a701-c500ff4ef2bc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:07.966461 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1436/2840] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:32:07 2022] PUT /identity/v3/projects/7930c13738104074b0c0862ed7089836/users/6277ed3f96904606bdb5db8c495f0f38/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:07.978711 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d93c2-38b8-4541-8a6e-5f8d134cee1c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:07.980578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d93c2-38b8-4541-8a6e-5f8d134cee1c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:07.980578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d93c2-38b8-4541-8a6e-5f8d134cee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:08.006782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c01d93c2-38b8-4541-8a6e-5f8d134cee1c None None] MFA Rules not processed for user `6277ed3f96904606bdb5db8c495f0f38`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:08.009275 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c01d93c2-38b8-4541-8a6e-5f8d134cee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:08.074264 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1405/2841] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:08.086035 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b12f0-c1ba-4fa9-a701-c500ff4ef2bc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:08.088070 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b14b12f0-c1ba-4fa9-a701-c500ff4ef2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:08.122724 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5717-b943-4391-ac8b-0fb174a63289 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:08.123084 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5717-b943-4391-ac8b-0fb174a63289 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:08.123463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5717-b943-4391-ac8b-0fb174a63289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:08.144010 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e35a5717-b943-4391-ac8b-0fb174a63289 None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:08.145316 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e35a5717-b943-4391-ac8b-0fb174a63289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:08.154065 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b12f0-c1ba-4fa9-a701-c500ff4ef2bc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:08.157653 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8e468-2871-442a-ab24-9e6d236911a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b8a5b38ac046ed8e8b98f0ecefb07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:08.158253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8e468-2871-442a-ab24-9e6d236911a5 service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:08.158622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8e468-2871-442a-ab24-9e6d236911a5 service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:08.158784 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8e468-2871-442a-ab24-9e6d236911a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:08.167125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8e468-2871-442a-ab24-9e6d236911a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:08.167903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:08.168673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8e468-2871-442a-ab24-9e6d236911a5 service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:08.177405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1437/2842] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:32:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:32:08.206419 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1406/2843] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 17 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:32:08.217430 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8e468-2871-442a-ab24-9e6d236911a5 service glance] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:08.219570 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2af8e468-2871-442a-ab24-9e6d236911a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:08.273096 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:08.294111 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8e468-2871-442a-ab24-9e6d236911a5 service glance] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:08.299514 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4a948-de1f-41f2-b055-32f9ee42e876 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:08.300125 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4a948-de1f-41f2-b055-32f9ee42e876 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:08.300403 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4a948-de1f-41f2-b055-32f9ee42e876 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:08.300673 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4a948-de1f-41f2-b055-32f9ee42e876 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:08.311105 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4a948-de1f-41f2-b055-32f9ee42e876 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:08.315062 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4a948-de1f-41f2-b055-32f9ee42e876 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:08.321293 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1438/2844] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:32:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:32:11.626508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5717-b943-4391-ac8b-0fb174a63289 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:11.627984 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e35a5717-b943-4391-ac8b-0fb174a63289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:11.697403 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5717-b943-4391-ac8b-0fb174a63289 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:11.702515 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf79519-ba04-47eb-8c9e-cd531d4191d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:11.703162 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf79519-ba04-47eb-8c9e-cd531d4191d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:11.703438 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf79519-ba04-47eb-8c9e-cd531d4191d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:11.703714 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf79519-ba04-47eb-8c9e-cd531d4191d0 admin admin] PATH_INFO: `/v3/users/38d4f9ef7e144b18860f111de9a79857` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:11.704863 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf79519-ba04-47eb-8c9e-cd531d4191d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d4f9ef7e144b18860f111de9a79857)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:11.706818 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf79519-ba04-47eb-8c9e-cd531d4191d0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:11.832493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-baf79519-ba04-47eb-8c9e-cd531d4191d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d4f9ef7e144b18860f111de9a79857'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:11.833243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-baf79519-ba04-47eb-8c9e-cd531d4191d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d4f9ef7e144b18860f111de9a79857'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:11.840760 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-baf79519-ba04-47eb-8c9e-cd531d4191d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d4f9ef7e144b18860f111de9a79857'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:11.853251 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-baf79519-ba04-47eb-8c9e-cd531d4191d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d4f9ef7e144b18860f111de9a79857'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:11.947268 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-baf79519-ba04-47eb-8c9e-cd531d4191d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d4f9ef7e144b18860f111de9a79857'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:11.953824 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1407/2845] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:32:11 2022] DELETE /identity/v3/users/38d4f9ef7e144b18860f111de9a79857 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:12.190176 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4a948-de1f-41f2-b055-32f9ee42e876 service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:12.201994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4a948-de1f-41f2-b055-32f9ee42e876 service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:12.272896 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:12.273559 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:12.273835 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:12.274662 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] PATH_INFO: `/v3/projects/fb5b81f86eae472abbee0b27755cfa9a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:12.276004 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5b81f86eae472abbee0b27755cfa9a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:12.277943 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:12.377098 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5b81f86eae472abbee0b27755cfa9a', 'request_id': 'req-051dd680-0e46-4604-86d6-17fd5e6f8f95'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:12.382853 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5b81f86eae472abbee0b27755cfa9a', 'request_id': 'req-051dd680-0e46-4604-86d6-17fd5e6f8f95'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:12.389405 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5b81f86eae472abbee0b27755cfa9a', 'request_id': 'req-051dd680-0e46-4604-86d6-17fd5e6f8f95'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:12.467883 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] The token cache is being invalidate because project fb5b81f86eae472abbee0b27755cfa9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:32:12.468107 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:12.468716 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-051dd680-0e46-4604-86d6-17fd5e6f8f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:12.470388 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1439/2846] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:32:12 2022] DELETE /identity/v3/projects/fb5b81f86eae472abbee0b27755cfa9a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:12.475508 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d5f1-00e4-49f3-9034-007cf00493ac None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:12.479932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d5f1-00e4-49f3-9034-007cf00493ac None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:12.479932 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d5f1-00e4-49f3-9034-007cf00493ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:12.496614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8dd4d5f1-00e4-49f3-9034-007cf00493ac None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:12.497847 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8dd4d5f1-00e4-49f3-9034-007cf00493ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:12.543525 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:12.558379 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1408/2847] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:32:12.566221 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172826d5-ad06-4099-8d0d-511ae75b0c64 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:12.566523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172826d5-ad06-4099-8d0d-511ae75b0c64 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:12.566820 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172826d5-ad06-4099-8d0d-511ae75b0c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:12.586059 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-172826d5-ad06-4099-8d0d-511ae75b0c64 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:12.588972 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-172826d5-ad06-4099-8d0d-511ae75b0c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:12.595288 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1440/2848] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:12.599614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4d5f1-00e4-49f3-9034-007cf00493ac None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:12.610538 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4d5f1-00e4-49f3-9034-007cf00493ac None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:12.615409 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c365c7-e63b-4cde-8b22-8afc1fd8f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:12.617564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c365c7-e63b-4cde-8b22-8afc1fd8f4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:12.617564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c365c7-e63b-4cde-8b22-8afc1fd8f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:12.617564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c365c7-e63b-4cde-8b22-8afc1fd8f4c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:12.617564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c365c7-e63b-4cde-8b22-8afc1fd8f4c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:32:12.617564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c365c7-e63b-4cde-8b22-8afc1fd8f4c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:12.620014 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c365c7-e63b-4cde-8b22-8afc1fd8f4c8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:12.632316 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1409/2849] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:32:12.636973 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172826d5-ad06-4099-8d0d-511ae75b0c64 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:12.646191 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172826d5-ad06-4099-8d0d-511ae75b0c64 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:12.651439 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a4ba7-6e92-423b-b644-2fb07bb32143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:12.652160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a4ba7-6e92-423b-b644-2fb07bb32143 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:12.652521 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a4ba7-6e92-423b-b644-2fb07bb32143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:12.652873 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a4ba7-6e92-423b-b644-2fb07bb32143 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:12.653536 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a4ba7-6e92-423b-b644-2fb07bb32143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:12.655812 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a4ba7-6e92-423b-b644-2fb07bb32143 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:12.750503 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1441/2850] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:32:12 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:32:12.755475 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c365c7-e63b-4cde-8b22-8afc1fd8f4c8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:12.766787 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c365c7-e63b-4cde-8b22-8afc1fd8f4c8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:12.825358 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b4274-8b08-4c33-b7cc-3fa544cc8343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:12.826139 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b4274-8b08-4c33-b7cc-3fa544cc8343 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:12.826397 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b4274-8b08-4c33-b7cc-3fa544cc8343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:12.826662 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b4274-8b08-4c33-b7cc-3fa544cc8343 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:12.827305 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b4274-8b08-4c33-b7cc-3fa544cc8343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:12.829238 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b4274-8b08-4c33-b7cc-3fa544cc8343 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:12.903418 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1410/2851] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:32:12 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:32:12.907441 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a4ba7-6e92-423b-b644-2fb07bb32143 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:12.918148 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a4ba7-6e92-423b-b644-2fb07bb32143 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:12.923891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd977-dfb3-4bca-8b4e-f8c9b26ec66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:12.924622 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd977-dfb3-4bca-8b4e-f8c9b26ec66f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:12.924954 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd977-dfb3-4bca-8b4e-f8c9b26ec66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:12.925249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd977-dfb3-4bca-8b4e-f8c9b26ec66f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:12.925969 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fd977-dfb3-4bca-8b4e-f8c9b26ec66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:12.927824 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fd977-dfb3-4bca-8b4e-f8c9b26ec66f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:12.939171 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1442/2852] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:32:12.943189 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b4274-8b08-4c33-b7cc-3fa544cc8343 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:12.954121 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b4274-8b08-4c33-b7cc-3fa544cc8343 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:12.958731 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3f205-137e-4139-8306-f2ec330a29b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:12.959320 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f205-137e-4139-8306-f2ec330a29b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:12.959616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f205-137e-4139-8306-f2ec330a29b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:12.959868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f205-137e-4139-8306-f2ec330a29b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:12.960504 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3f205-137e-4139-8306-f2ec330a29b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:12.962513 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3f205-137e-4139-8306-f2ec330a29b8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:12.974838 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1411/2853] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:32:12.979375 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd977-dfb3-4bca-8b4e-f8c9b26ec66f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:12.989645 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd977-dfb3-4bca-8b4e-f8c9b26ec66f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:12.995273 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009913b-5ca4-40eb-8ae8-ead68372fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:12.995920 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009913b-5ca4-40eb-8ae8-ead68372fc60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:12.996202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009913b-5ca4-40eb-8ae8-ead68372fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:12.996479 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009913b-5ca4-40eb-8ae8-ead68372fc60 admin admin] PATH_INFO: `/v3/projects/e51910d8aa6841f98956a451649aa883/users/718b58c5163a4afc9be695cc9fc05cd7/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:13.012601 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009913b-5ca4-40eb-8ae8-ead68372fc60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51910d8aa6841f98956a451649aa883, user_id=718b58c5163a4afc9be695cc9fc05cd7, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:13.015289 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009913b-5ca4-40eb-8ae8-ead68372fc60 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:13.154711 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1443/2854] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:32:12 2022] PUT /identity/v3/projects/e51910d8aa6841f98956a451649aa883/users/718b58c5163a4afc9be695cc9fc05cd7/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:13.159876 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2cf4-ed01-471c-b16e-0f59baa982ff None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:13.160158 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2cf4-ed01-471c-b16e-0f59baa982ff None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:13.160428 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2cf4-ed01-471c-b16e-0f59baa982ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:13.180080 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c90b2cf4-ed01-471c-b16e-0f59baa982ff None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:13.181991 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c90b2cf4-ed01-471c-b16e-0f59baa982ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:13.249899 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1412/2855] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:13.260321 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009913b-5ca4-40eb-8ae8-ead68372fc60 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:13.262550 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1009913b-5ca4-40eb-8ae8-ead68372fc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:13.269290 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:13.323917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009913b-5ca4-40eb-8ae8-ead68372fc60 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:13.327598 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be896333-56ae-4ed2-a61b-a8e451687d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:13.328314 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be896333-56ae-4ed2-a61b-a8e451687d8d service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:13.328593 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be896333-56ae-4ed2-a61b-a8e451687d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:13.328863 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be896333-56ae-4ed2-a61b-a8e451687d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:13.338474 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be896333-56ae-4ed2-a61b-a8e451687d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:13.339948 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be896333-56ae-4ed2-a61b-a8e451687d8d service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:13.349497 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1444/2856] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:32:18.687456 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab30ce1-6793-491a-9b21-911cb4e7419d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:18.688017 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab30ce1-6793-491a-9b21-911cb4e7419d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:18.688017 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab30ce1-6793-491a-9b21-911cb4e7419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:18.718437 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6ab30ce1-6793-491a-9b21-911cb4e7419d None None] MFA Rules not processed for user `718b58c5163a4afc9be695cc9fc05cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:18.719658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6ab30ce1-6793-491a-9b21-911cb4e7419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:18.768269 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:18.789307 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1413/2857] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:18.795046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be896333-56ae-4ed2-a61b-a8e451687d8d service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:18.804994 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be896333-56ae-4ed2-a61b-a8e451687d8d service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:18.809998 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35676a83-7028-401c-ba2c-dc72bff0acd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:18.810612 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35676a83-7028-401c-ba2c-dc72bff0acd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:18.810890 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35676a83-7028-401c-ba2c-dc72bff0acd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:18.811162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35676a83-7028-401c-ba2c-dc72bff0acd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:18.811786 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35676a83-7028-401c-ba2c-dc72bff0acd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:18.813744 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35676a83-7028-401c-ba2c-dc72bff0acd7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:18.910113 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab30ce1-6793-491a-9b21-911cb4e7419d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:18.910911 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1445/2858] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:32:18 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:32:18.923578 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab30ce1-6793-491a-9b21-911cb4e7419d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:19.005145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66222af-4ded-42a3-88cf-6b0c2ca8cc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:19.005773 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66222af-4ded-42a3-88cf-6b0c2ca8cc56 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:19.006052 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66222af-4ded-42a3-88cf-6b0c2ca8cc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:19.006322 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66222af-4ded-42a3-88cf-6b0c2ca8cc56 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:19.006964 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66222af-4ded-42a3-88cf-6b0c2ca8cc56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:19.009668 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66222af-4ded-42a3-88cf-6b0c2ca8cc56 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:19.096795 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1414/2859] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:32:18 2022] POST /identity/v3/users => generated 299 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:32:19.100703 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35676a83-7028-401c-ba2c-dc72bff0acd7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:19.112389 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35676a83-7028-401c-ba2c-dc72bff0acd7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:19.120291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af904aa-133b-4f3a-b4f4-1e6cb677ba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:19.120291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af904aa-133b-4f3a-b4f4-1e6cb677ba96 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:19.120291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af904aa-133b-4f3a-b4f4-1e6cb677ba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:19.120291 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af904aa-133b-4f3a-b4f4-1e6cb677ba96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:19.120922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af904aa-133b-4f3a-b4f4-1e6cb677ba96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:19.120922 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af904aa-133b-4f3a-b4f4-1e6cb677ba96 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:19.136574 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1446/2860] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:32:19.140686 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66222af-4ded-42a3-88cf-6b0c2ca8cc56 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:19.152762 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66222af-4ded-42a3-88cf-6b0c2ca8cc56 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:19.157408 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a167977-fa92-475a-bb36-1da694370e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:19.158069 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a167977-fa92-475a-bb36-1da694370e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:19.158344 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a167977-fa92-475a-bb36-1da694370e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:19.158660 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a167977-fa92-475a-bb36-1da694370e58 admin admin] PATH_INFO: `/v3/projects/48fe6810b47843939c2684f248d1d46e/users/f51dce593c814b149f19ac904173a6c1/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:19.174826 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a167977-fa92-475a-bb36-1da694370e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48fe6810b47843939c2684f248d1d46e, user_id=f51dce593c814b149f19ac904173a6c1, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:19.177665 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a167977-fa92-475a-bb36-1da694370e58 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:19.222563 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1415/2861] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:32:19 2022] PUT /identity/v3/projects/48fe6810b47843939c2684f248d1d46e/users/f51dce593c814b149f19ac904173a6c1/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:32:19.226787 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af904aa-133b-4f3a-b4f4-1e6cb677ba96 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:19.236681 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af904aa-133b-4f3a-b4f4-1e6cb677ba96 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:19.293331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d0860-edee-46f2-88d2-ac4f6f946cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:19.293892 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d0860-edee-46f2-88d2-ac4f6f946cec admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:19.294168 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d0860-edee-46f2-88d2-ac4f6f946cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:19.294436 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d0860-edee-46f2-88d2-ac4f6f946cec admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:19.295709 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d0860-edee-46f2-88d2-ac4f6f946cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:19.297329 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d0860-edee-46f2-88d2-ac4f6f946cec admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:19.307006 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1447/2862] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:32:19.311420 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a167977-fa92-475a-bb36-1da694370e58 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:19.322317 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a167977-fa92-475a-bb36-1da694370e58 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:19.327066 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700d841-8936-4564-a900-a270874635c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:19.327803 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700d841-8936-4564-a900-a270874635c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:19.328076 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700d841-8936-4564-a900-a270874635c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:19.328341 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700d841-8936-4564-a900-a270874635c8 admin admin] PATH_INFO: `/v3/projects/48fe6810b47843939c2684f248d1d46e/users/f51dce593c814b149f19ac904173a6c1/roles/28beda93f70d4c549352145ddee01aac` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:19.330745 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700d841-8936-4564-a900-a270874635c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48fe6810b47843939c2684f248d1d46e, user_id=f51dce593c814b149f19ac904173a6c1, role_id=28beda93f70d4c549352145ddee01aac)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:19.333429 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700d841-8936-4564-a900-a270874635c8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:19.345181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1416/2863] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:32:19 2022] PUT /identity/v3/projects/48fe6810b47843939c2684f248d1d46e/users/f51dce593c814b149f19ac904173a6c1/roles/28beda93f70d4c549352145ddee01aac => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:32:24.849953 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1962cb-ed2b-4042-96b7-baaf1923f8e6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:24.850495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1962cb-ed2b-4042-96b7-baaf1923f8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:24.850495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1962cb-ed2b-4042-96b7-baaf1923f8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:24.882528 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3c1962cb-ed2b-4042-96b7-baaf1923f8e6 None None] MFA Rules not processed for user `f51dce593c814b149f19ac904173a6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:24.887398 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3c1962cb-ed2b-4042-96b7-baaf1923f8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:24.957523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:24.969506 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1448/2864] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:24.981966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700d841-8936-4564-a900-a270874635c8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:24.983755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b700d841-8936-4564-a900-a270874635c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:25.047883 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700d841-8936-4564-a900-a270874635c8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:25.052324 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50c32-38bd-47aa-a08a-1b3718e37dc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b8a5b38ac046ed8e8b98f0ecefb07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:25.053008 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50c32-38bd-47aa-a08a-1b3718e37dc5 service glance] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:25.053292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50c32-38bd-47aa-a08a-1b3718e37dc5 service glance] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:25.053707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50c32-38bd-47aa-a08a-1b3718e37dc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:25.118424 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:25.122980 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba50c32-38bd-47aa-a08a-1b3718e37dc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:25.124407 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba50c32-38bd-47aa-a08a-1b3718e37dc5 service glance] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:25.136836 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1417/2865] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:32:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:32:25.426732 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed65199-792a-4ac0-9274-194a94d4f5b2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:25.427014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed65199-792a-4ac0-9274-194a94d4f5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:25.427308 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed65199-792a-4ac0-9274-194a94d4f5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:25.448094 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9ed65199-792a-4ac0-9274-194a94d4f5b2 None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:25.449451 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9ed65199-792a-4ac0-9274-194a94d4f5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:25.511979 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1449/2866] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:25.525295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50c32-38bd-47aa-a08a-1b3718e37dc5 service glance] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:25.526782 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-eba50c32-38bd-47aa-a08a-1b3718e37dc5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:25.611965 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50c32-38bd-47aa-a08a-1b3718e37dc5 service glance] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:25.617382 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70db4fe-7375-4b07-9b7d-1ce18a8cc234 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:25.618019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70db4fe-7375-4b07-9b7d-1ce18a8cc234 service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:25.618293 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70db4fe-7375-4b07-9b7d-1ce18a8cc234 service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:25.619146 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70db4fe-7375-4b07-9b7d-1ce18a8cc234 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:25.628900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70db4fe-7375-4b07-9b7d-1ce18a8cc234 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:25.631459 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70db4fe-7375-4b07-9b7d-1ce18a8cc234 service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:25.641753 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1418/2867] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:32:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 16:32:33.590643 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed65199-792a-4ac0-9274-194a94d4f5b2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:33.592238 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9ed65199-792a-4ac0-9274-194a94d4f5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:33.670266 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed65199-792a-4ac0-9274-194a94d4f5b2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:33.675931 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:33.676563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:33.676995 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:33.677216 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] PATH_INFO: `/v3/users/6277ed3f96904606bdb5db8c495f0f38` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:33.678397 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6277ed3f96904606bdb5db8c495f0f38)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:33.680324 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:33.810287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6277ed3f96904606bdb5db8c495f0f38'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:33.810996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6277ed3f96904606bdb5db8c495f0f38'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:33.826849 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6277ed3f96904606bdb5db8c495f0f38'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:33.836434 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6277ed3f96904606bdb5db8c495f0f38'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:33.837625 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6277ed3f96904606bdb5db8c495f0f38'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:33.896805 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1450/2868] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:32:33 2022] DELETE /identity/v3/users/6277ed3f96904606bdb5db8c495f0f38 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:33.902047 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422de28-7cfc-4ee6-9cbb-a6b61b0aa111 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:33.902987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422de28-7cfc-4ee6-9cbb-a6b61b0aa111 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:33.903490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422de28-7cfc-4ee6-9cbb-a6b61b0aa111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:33.927357 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a422de28-7cfc-4ee6-9cbb-a6b61b0aa111 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:33.930498 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a422de28-7cfc-4ee6-9cbb-a6b61b0aa111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:34.003658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1419/2869] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:34.014565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:34.016166 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:34.046101 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:34.089970 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1cec-9fc1-4129-824b-0cc97e2a1b15 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:34.094222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf44b2-74bc-4394-b510-d9e6697576e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:34.095038 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf44b2-74bc-4394-b510-d9e6697576e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:34.095495 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf44b2-74bc-4394-b510-d9e6697576e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:34.095934 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf44b2-74bc-4394-b510-d9e6697576e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:34.109678 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf44b2-74bc-4394-b510-d9e6697576e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:34.111141 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf44b2-74bc-4394-b510-d9e6697576e6 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:34.122521 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1451/2870] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:32:34.549833 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422de28-7cfc-4ee6-9cbb-a6b61b0aa111 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:34.551529 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a422de28-7cfc-4ee6-9cbb-a6b61b0aa111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:34.566226 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422de28-7cfc-4ee6-9cbb-a6b61b0aa111 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:34.571196 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:34.571912 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:34.572187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:34.572454 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] PATH_INFO: `/v3/projects/7930c13738104074b0c0862ed7089836` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:34.573743 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7930c13738104074b0c0862ed7089836)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:34.575746 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:34.935911 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7930c13738104074b0c0862ed7089836', 'request_id': 'req-b60b72cc-d47f-4b04-acb5-c6908724f3ea'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:34.941614 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7930c13738104074b0c0862ed7089836', 'request_id': 'req-b60b72cc-d47f-4b04-acb5-c6908724f3ea'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:35.010775 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7930c13738104074b0c0862ed7089836', 'request_id': 'req-b60b72cc-d47f-4b04-acb5-c6908724f3ea'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:35.024895 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] The token cache is being invalidate because project 7930c13738104074b0c0862ed7089836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:32:35.025284 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:35.026155 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b60b72cc-d47f-4b04-acb5-c6908724f3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:32:35.030208 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1420/2871] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:32:34 2022] DELETE /identity/v3/projects/7930c13738104074b0c0862ed7089836 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:35.032838 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06668e4-4c7d-4754-908e-2320929b2da4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:35.033331 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06668e4-4c7d-4754-908e-2320929b2da4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:35.033475 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06668e4-4c7d-4754-908e-2320929b2da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:35.055422 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d06668e4-4c7d-4754-908e-2320929b2da4 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:35.056830 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d06668e4-4c7d-4754-908e-2320929b2da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:35.127219 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1452/2872] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:35.135995 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd238d3-c6f4-405f-a6cc-878c0c98295e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:35.136306 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd238d3-c6f4-405f-a6cc-878c0c98295e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:35.136550 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd238d3-c6f4-405f-a6cc-878c0c98295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:35.153971 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:35.159675 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5bd238d3-c6f4-405f-a6cc-878c0c98295e None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:35.160900 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5bd238d3-c6f4-405f-a6cc-878c0c98295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:35.171106 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1421/2873] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:35.175597 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06668e4-4c7d-4754-908e-2320929b2da4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:35.188776 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06668e4-4c7d-4754-908e-2320929b2da4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:35.194279 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be127b-d1bb-4db5-a0a6-125e2bf234ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:35.202380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be127b-d1bb-4db5-a0a6-125e2bf234ae admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:35.202380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be127b-d1bb-4db5-a0a6-125e2bf234ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:35.202380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be127b-d1bb-4db5-a0a6-125e2bf234ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:35.202380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be127b-d1bb-4db5-a0a6-125e2bf234ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:32:35.202380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be127b-d1bb-4db5-a0a6-125e2bf234ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:35.202380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be127b-d1bb-4db5-a0a6-125e2bf234ae admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:35.213686 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1453/2874] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 17 16:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:32:35.218505 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd238d3-c6f4-405f-a6cc-878c0c98295e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:35.228572 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd238d3-c6f4-405f-a6cc-878c0c98295e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:35.233467 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8e607-e3a3-4ca3-9cc8-878126493303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:35.234147 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8e607-e3a3-4ca3-9cc8-878126493303 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:35.234398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8e607-e3a3-4ca3-9cc8-878126493303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:35.234669 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8e607-e3a3-4ca3-9cc8-878126493303 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:35.235289 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8e607-e3a3-4ca3-9cc8-878126493303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:35.237201 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8e607-e3a3-4ca3-9cc8-878126493303 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:35.346926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1422/2875] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 17 16:32:35 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:32:35.351249 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be127b-d1bb-4db5-a0a6-125e2bf234ae admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:35.363307 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be127b-d1bb-4db5-a0a6-125e2bf234ae admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:35.427707 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf4695-f635-463d-aa0b-d5df5ee854e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:35.428318 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf4695-f635-463d-aa0b-d5df5ee854e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:35.428649 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf4695-f635-463d-aa0b-d5df5ee854e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:35.428927 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf4695-f635-463d-aa0b-d5df5ee854e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:35.429668 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf4695-f635-463d-aa0b-d5df5ee854e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:35.432380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf4695-f635-463d-aa0b-d5df5ee854e4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:35.526654 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1454/2876] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 17 16:32:35 2022] POST /identity/v3/users => generated 282 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:32:35.527947 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8e607-e3a3-4ca3-9cc8-878126493303 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:35.538252 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8e607-e3a3-4ca3-9cc8-878126493303 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:35.543402 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9ca36-b1fa-4b8d-b5b0-536ddf0eed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:35.544053 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9ca36-b1fa-4b8d-b5b0-536ddf0eed4c admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:35.544300 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9ca36-b1fa-4b8d-b5b0-536ddf0eed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:35.544569 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9ca36-b1fa-4b8d-b5b0-536ddf0eed4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:35.545199 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9ca36-b1fa-4b8d-b5b0-536ddf0eed4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:35.546830 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9ca36-b1fa-4b8d-b5b0-536ddf0eed4c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:35.557806 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1423/2877] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:32:35.561796 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf4695-f635-463d-aa0b-d5df5ee854e4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:35.572635 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf4695-f635-463d-aa0b-d5df5ee854e4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:35.577278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a92d9b-4158-4cc3-a4a1-818a734bef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:35.577917 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92d9b-4158-4cc3-a4a1-818a734bef49 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:35.578195 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92d9b-4158-4cc3-a4a1-818a734bef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:35.578498 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92d9b-4158-4cc3-a4a1-818a734bef49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:35.579161 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a92d9b-4158-4cc3-a4a1-818a734bef49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:35.580760 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a92d9b-4158-4cc3-a4a1-818a734bef49 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:35.591990 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1455/2878] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 17 16:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:32:35.596511 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9ca36-b1fa-4b8d-b5b0-536ddf0eed4c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:35.607627 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9ca36-b1fa-4b8d-b5b0-536ddf0eed4c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:35.612267 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6c0f0-64ae-41b2-9244-b7a3993d2e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:35.612966 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6c0f0-64ae-41b2-9244-b7a3993d2e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:35.613229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6c0f0-64ae-41b2-9244-b7a3993d2e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:35.613735 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6c0f0-64ae-41b2-9244-b7a3993d2e39 admin admin] PATH_INFO: `/v3/projects/d173a6da6eea44908e0ab1dcf5d72291/users/59b4cc7d25ac42fabeedc3db3495e957/roles/a64cd92139fb4f1fb64f05f5a88f999f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:35.636019 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6c0f0-64ae-41b2-9244-b7a3993d2e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d173a6da6eea44908e0ab1dcf5d72291, user_id=59b4cc7d25ac42fabeedc3db3495e957, role_id=a64cd92139fb4f1fb64f05f5a88f999f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:35.638737 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6c0f0-64ae-41b2-9244-b7a3993d2e39 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:35.713868 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1424/2879] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 17 16:32:35 2022] PUT /identity/v3/projects/d173a6da6eea44908e0ab1dcf5d72291/users/59b4cc7d25ac42fabeedc3db3495e957/roles/a64cd92139fb4f1fb64f05f5a88f999f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:32:35.724522 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98912a97-e9c1-4bbe-8951-b273b29b3cd5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:35.725014 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98912a97-e9c1-4bbe-8951-b273b29b3cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:35.725337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98912a97-e9c1-4bbe-8951-b273b29b3cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:35.765163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-98912a97-e9c1-4bbe-8951-b273b29b3cd5 None None] MFA Rules not processed for user `59b4cc7d25ac42fabeedc3db3495e957`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:35.765163 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-98912a97-e9c1-4bbe-8951-b273b29b3cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:35.778589 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:35.831723 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1456/2880] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:35.832050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95381f7-f5dd-443f-899b-777ad86c2040 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:35.832363 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95381f7-f5dd-443f-899b-777ad86c2040 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:35.832664 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95381f7-f5dd-443f-899b-777ad86c2040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:35.842967 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98912a97-e9c1-4bbe-8951-b273b29b3cd5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:35.844484 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-98912a97-e9c1-4bbe-8951-b273b29b3cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:35.853924 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f95381f7-f5dd-443f-899b-777ad86c2040 None None] MFA Rules not processed for user `718b58c5163a4afc9be695cc9fc05cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:35.855353 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f95381f7-f5dd-443f-899b-777ad86c2040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:35.925516 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1425/2881] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:35.926350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98912a97-e9c1-4bbe-8951-b273b29b3cd5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:35.930997 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc2c7e-5105-4b05-a91c-6cceea16374e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4227da1895a94c9c845c4f7adf838144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:35.931955 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2c7e-5105-4b05-a91c-6cceea16374e service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:35.932233 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2c7e-5105-4b05-a91c-6cceea16374e service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:35.932499 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2c7e-5105-4b05-a91c-6cceea16374e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:35.941629 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc2c7e-5105-4b05-a91c-6cceea16374e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:35.943115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc2c7e-5105-4b05-a91c-6cceea16374e service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:35.952937 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1457/2882] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:32:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:32:39.273398 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28405811-7dc7-4e86-95b1-eb257fb74fe1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:39.273903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28405811-7dc7-4e86-95b1-eb257fb74fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:39.274006 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28405811-7dc7-4e86-95b1-eb257fb74fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:39.294063 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-28405811-7dc7-4e86-95b1-eb257fb74fe1 None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:32:39.295659 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-28405811-7dc7-4e86-95b1-eb257fb74fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:39.358249 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1426/2883] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 17 16:32:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:32:39.380393 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc2c7e-5105-4b05-a91c-6cceea16374e service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:39.381964 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2bbc2c7e-5105-4b05-a91c-6cceea16374e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:39.465380 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc2c7e-5105-4b05-a91c-6cceea16374e service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:39.479777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da54ddc-a673-44b9-bdd5-4875a7df7f5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:39.479777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da54ddc-a673-44b9-bdd5-4875a7df7f5a service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:39.479777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da54ddc-a673-44b9-bdd5-4875a7df7f5a service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:39.479777 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da54ddc-a673-44b9-bdd5-4875a7df7f5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:39.486926 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da54ddc-a673-44b9-bdd5-4875a7df7f5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:39.488769 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da54ddc-a673-44b9-bdd5-4875a7df7f5a service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:39.501486 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1458/2884] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:32:49.350707 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=74,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:49.495996 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=82 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:32:53.805050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28405811-7dc7-4e86-95b1-eb257fb74fe1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:32:53.807827 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-28405811-7dc7-4e86-95b1-eb257fb74fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:53.867092 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28405811-7dc7-4e86-95b1-eb257fb74fe1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:32:53.871881 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1469d-c2e3-47a6-b0ff-e6466d811c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:32:53.872715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1469d-c2e3-47a6-b0ff-e6466d811c16 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:32:53.873061 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1469d-c2e3-47a6-b0ff-e6466d811c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:32:53.873328 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1469d-c2e3-47a6-b0ff-e6466d811c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:32:53.875440 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a4c1469d-c2e3-47a6-b0ff-e6466d811c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:32:53.942311 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1469d-c2e3-47a6-b0ff-e6466d811c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:32:53.943765 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1469d-c2e3-47a6-b0ff-e6466d811c16 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:32:53.953845 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1427/2885] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:33:01.746072 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da54ddc-a673-44b9-bdd5-4875a7df7f5a service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:33:01.747667 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4da54ddc-a673-44b9-bdd5-4875a7df7f5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:01.762676 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da54ddc-a673-44b9-bdd5-4875a7df7f5a service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:33:01.767246 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:33:01.767866 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:01.768144 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:01.768411 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] PATH_INFO: `/v3/users/abf35fc0be0e476291410f8657a44841` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:01.769538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf35fc0be0e476291410f8657a44841)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:33:01.771446 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:33:01.914669 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf35fc0be0e476291410f8657a44841'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:01.915410 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf35fc0be0e476291410f8657a44841'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:01.927245 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf35fc0be0e476291410f8657a44841'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:01.934243 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf35fc0be0e476291410f8657a44841'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:01.934885 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf35fc0be0e476291410f8657a44841'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:02.031799 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1459/2886] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:33:01 2022] DELETE /identity/v3/users/abf35fc0be0e476291410f8657a44841 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:33:02.321028 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1469d-c2e3-47a6-b0ff-e6466d811c16 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:33:02.331295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1469d-c2e3-47a6-b0ff-e6466d811c16 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:33:02.405656 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:33:02.406295 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:02.406573 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:02.406841 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] PATH_INFO: `/v3/projects/aa5d5b9a56e44afaa4740d9c6055ca01` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:02.408056 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa5d5b9a56e44afaa4740d9c6055ca01)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:33:02.410038 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:33:02.500575 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa5d5b9a56e44afaa4740d9c6055ca01', 'request_id': 'req-f95ae64f-18c1-4c09-8d0a-3e9061d74965'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:02.502621 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:33:02.507055 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa5d5b9a56e44afaa4740d9c6055ca01', 'request_id': 'req-f95ae64f-18c1-4c09-8d0a-3e9061d74965'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:02.568194 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa5d5b9a56e44afaa4740d9c6055ca01', 'request_id': 'req-f95ae64f-18c1-4c09-8d0a-3e9061d74965'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:02.580564 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] The token cache is being invalidate because project aa5d5b9a56e44afaa4740d9c6055ca01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:33:02.580851 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:02.581520 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:02.583000 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1428/2887] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:33:02 2022] DELETE /identity/v3/projects/aa5d5b9a56e44afaa4740d9c6055ca01 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:33:02.586897 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:33:02.588414 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:02.603384 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3611840-f027-428d-92ce-915fdccf9033 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:33:02.667242 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:33:02.667913 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:02.668193 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:02.668467 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] PATH_INFO: `/v3/users/f332c0b1fae14375ab56829703361317` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:02.669662 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f332c0b1fae14375ab56829703361317)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:33:02.671696 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:33:02.873337 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f332c0b1fae14375ab56829703361317'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:02.874005 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f332c0b1fae14375ab56829703361317'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:02.887700 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f332c0b1fae14375ab56829703361317'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:02.906832 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f332c0b1fae14375ab56829703361317'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:02.908129 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f332c0b1fae14375ab56829703361317'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:02.910050 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:33:02.956913 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1460/2888] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:33:02 2022] DELETE /identity/v3/users/f332c0b1fae14375ab56829703361317 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:33:03.220243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:33:03.223672 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:03.235123 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ae64f-18c1-4c09-8d0a-3e9061d74965 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:33:03.294940 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:33:03.295612 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:03.295885 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:03.296153 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] PATH_INFO: `/v3/projects/c034c88971ad4c349d9f3d828962cec1` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:03.297243 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c034c88971ad4c349d9f3d828962cec1)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:33:03.299234 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:33:03.455495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c034c88971ad4c349d9f3d828962cec1', 'request_id': 'req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:03.461018 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c034c88971ad4c349d9f3d828962cec1', 'request_id': 'req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:03.572658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c034c88971ad4c349d9f3d828962cec1', 'request_id': 'req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:03.585229 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] The token cache is being invalidate because project c034c88971ad4c349d9f3d828962cec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:33:03.585551 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:03.586256 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:03.587723 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1429/2889] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:33:03 2022] DELETE /identity/v3/projects/c034c88971ad4c349d9f3d828962cec1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:33:05.880523 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:33:05.882206 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:05.943244 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd743b-aefd-44f5-80a1-13e82c159ec1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:33:05.993022 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedce819-67a8-4a81-a0cc-f122a7203188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:33:05.993666 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedce819-67a8-4a81-a0cc-f122a7203188 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:05.993985 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedce819-67a8-4a81-a0cc-f122a7203188 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:05.996046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedce819-67a8-4a81-a0cc-f122a7203188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:05.996046 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fedce819-67a8-4a81-a0cc-f122a7203188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:06.059915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedce819-67a8-4a81-a0cc-f122a7203188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:33:06.061385 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedce819-67a8-4a81-a0cc-f122a7203188 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:33:06.071726 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1461/2890] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:33:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:33:11.427842 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:33:11.429860 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:11.510702 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9c48a-5295-4d7b-90f5-4ad3e7cd4e8a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:33:11.515544 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:33:11.516187 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:11.516463 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:11.516733 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] PATH_INFO: `/v3/users/59b4cc7d25ac42fabeedc3db3495e957` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:11.517998 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b4cc7d25ac42fabeedc3db3495e957)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:33:11.520715 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:33:11.541999 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:33:11.726936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b4cc7d25ac42fabeedc3db3495e957'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:11.727826 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b4cc7d25ac42fabeedc3db3495e957'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:11.736359 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b4cc7d25ac42fabeedc3db3495e957'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:11.751926 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b4cc7d25ac42fabeedc3db3495e957'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:11.808112 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b4cc7d25ac42fabeedc3db3495e957'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:11.816401 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1430/2891] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:33:11 2022] DELETE /identity/v3/users/59b4cc7d25ac42fabeedc3db3495e957 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:33:11.821410 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb420b7c-7202-4c42-a338-f32cd9cf6809 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:11.822576 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb420b7c-7202-4c42-a338-f32cd9cf6809 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:11.822874 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb420b7c-7202-4c42-a338-f32cd9cf6809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:11.843991 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-eb420b7c-7202-4c42-a338-f32cd9cf6809 None None] MFA Rules not processed for user `ff587d68b0de4327bd4c0d90116b3380`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:33:11.845202 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-eb420b7c-7202-4c42-a338-f32cd9cf6809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:11.905019 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:33:11.915285 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1462/2892] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 17 16:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:33:11.925969 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:33:11.927387 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:11.986347 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c288f9-4822-4d47-a1f3-95deacf8ef95 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:33:11.989898 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c98c-2a4a-4e8b-a827-10e361497946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:33:11.990490 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c98c-2a4a-4e8b-a827-10e361497946 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:11.990763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c98c-2a4a-4e8b-a827-10e361497946 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:11.991026 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c98c-2a4a-4e8b-a827-10e361497946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:12.000242 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596c98c-2a4a-4e8b-a827-10e361497946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:33:12.001740 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596c98c-2a4a-4e8b-a827-10e361497946 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:33:12.012414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1431/2893] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:33:12.409198 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb420b7c-7202-4c42-a338-f32cd9cf6809 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:33:12.410651 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-eb420b7c-7202-4c42-a338-f32cd9cf6809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:12.424154 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb420b7c-7202-4c42-a338-f32cd9cf6809 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:33:12.429765 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:33:12.430564 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:12.430840 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:12.431165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] PATH_INFO: `/v3/projects/d173a6da6eea44908e0ab1dcf5d72291` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:12.435779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d173a6da6eea44908e0ab1dcf5d72291)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:33:12.435779 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:33:12.585139 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd173a6da6eea44908e0ab1dcf5d72291', 'request_id': 'req-d9f2611d-7cd2-4875-beb5-90b09afedfc2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:12.590821 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd173a6da6eea44908e0ab1dcf5d72291', 'request_id': 'req-d9f2611d-7cd2-4875-beb5-90b09afedfc2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:12.596966 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd173a6da6eea44908e0ab1dcf5d72291', 'request_id': 'req-d9f2611d-7cd2-4875-beb5-90b09afedfc2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:12.675222 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] The token cache is being invalidate because project d173a6da6eea44908e0ab1dcf5d72291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:33:12.675505 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:12.676115 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:33:12.677662 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1463/2894] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:33:12 2022] DELETE /identity/v3/projects/d173a6da6eea44908e0ab1dcf5d72291 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:33:22.006936 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=48,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:33:22.672060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:33:35.125944 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c98c-2a4a-4e8b-a827-10e361497946 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:33:35.136073 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c98c-2a4a-4e8b-a827-10e361497946 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:33:35.188485 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704160-f92f-401a-a933-26c435e736e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:33:35.189075 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704160-f92f-401a-a933-26c435e736e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:35.189394 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704160-f92f-401a-a933-26c435e736e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:35.189667 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704160-f92f-401a-a933-26c435e736e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:35.191368 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-58704160-f92f-401a-a933-26c435e736e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:35.285617 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58704160-f92f-401a-a933-26c435e736e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:33:35.287120 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58704160-f92f-401a-a933-26c435e736e4 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:33:35.311369 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1432/2895] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:33:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:33:36.623189 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:33:36.624826 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:36.638024 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2611d-7cd2-4875-beb5-90b09afedfc2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:33:36.641521 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c87c02-c361-43db-bef7-5b98fd43b34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:33:36.642502 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c87c02-c361-43db-bef7-5b98fd43b34b service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:36.642891 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c87c02-c361-43db-bef7-5b98fd43b34b service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:36.643160 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c87c02-c361-43db-bef7-5b98fd43b34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:36.644806 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d4c87c02-c361-43db-bef7-5b98fd43b34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:36.658989 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c87c02-c361-43db-bef7-5b98fd43b34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:33:36.660418 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c87c02-c361-43db-bef7-5b98fd43b34b service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:33:36.671870 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1464/2896] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:33:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:33:45.308050 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=63 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:33:46.666959 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:34:26.080141 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704160-f92f-401a-a933-26c435e736e4 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:34:26.082763 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-58704160-f92f-401a-a933-26c435e736e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:34:26.094800 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704160-f92f-401a-a933-26c435e736e4 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:34:26.098618 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65648a37-7b62-425e-a3cb-34f414f28484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad54a22e6e747d9887c82bb62a923da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:34:26.099233 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648a37-7b62-425e-a3cb-34f414f28484 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:34:26.099510 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648a37-7b62-425e-a3cb-34f414f28484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:34:26.099778 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648a37-7b62-425e-a3cb-34f414f28484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:34:26.101560 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-65648a37-7b62-425e-a3cb-34f414f28484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:34:26.118292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65648a37-7b62-425e-a3cb-34f414f28484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:34:26.118292 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65648a37-7b62-425e-a3cb-34f414f28484 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:34:26.125272 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1433/2897] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:34:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:34:35.450965 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815b23c-d737-4b1d-ab75-c8e1bf8ac8e8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:34:35.451459 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815b23c-d737-4b1d-ab75-c8e1bf8ac8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:34:35.451565 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815b23c-d737-4b1d-ab75-c8e1bf8ac8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:34:35.501710 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4815b23c-d737-4b1d-ab75-c8e1bf8ac8e8 None None] MFA Rules not processed for user `666d255c72394f4e9faaeb5b94253cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:34:35.502906 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4815b23c-d737-4b1d-ab75-c8e1bf8ac8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:34:35.568581 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1465/2898] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 17 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:34:35.609040 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65648a37-7b62-425e-a3cb-34f414f28484 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:34:35.610492 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-65648a37-7b62-425e-a3cb-34f414f28484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:34:35.708493 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65648a37-7b62-425e-a3cb-34f414f28484 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:34:35.714266 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372391-a18f-4bb7-bc23-264b0daeac93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a2326353998441c938abf274b5e5dd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:34:35.714870 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372391-a18f-4bb7-bc23-264b0daeac93 service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:34:35.715145 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372391-a18f-4bb7-bc23-264b0daeac93 service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:34:35.715413 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372391-a18f-4bb7-bc23-264b0daeac93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:34:35.723414 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97372391-a18f-4bb7-bc23-264b0daeac93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:34:35.724987 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97372391-a18f-4bb7-bc23-264b0daeac93 service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:34:35.733205 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1434/2899] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 17 16:34:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:34:43.831362 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815b23c-d737-4b1d-ab75-c8e1bf8ac8e8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:34:43.832915 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4815b23c-d737-4b1d-ab75-c8e1bf8ac8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:34:43.900363 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815b23c-d737-4b1d-ab75-c8e1bf8ac8e8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:34:43.904936 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:34:43.909287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:34:43.909287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:34:43.909287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] PATH_INFO: `/v3/users/718b58c5163a4afc9be695cc9fc05cd7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:34:43.909287 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=718b58c5163a4afc9be695cc9fc05cd7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:34:43.909677 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:34:44.110560 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718b58c5163a4afc9be695cc9fc05cd7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:44.111206 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718b58c5163a4afc9be695cc9fc05cd7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:44.123538 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718b58c5163a4afc9be695cc9fc05cd7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:44.130616 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718b58c5163a4afc9be695cc9fc05cd7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:44.131253 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718b58c5163a4afc9be695cc9fc05cd7'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:44.132872 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:34:44.252954 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1466/2900] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:34:43 2022] DELETE /identity/v3/users/718b58c5163a4afc9be695cc9fc05cd7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:34:44.506568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372391-a18f-4bb7-bc23-264b0daeac93 service swift] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:34:44.518192 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372391-a18f-4bb7-bc23-264b0daeac93 service swift] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:34:44.576258 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:34:44.576897 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:34:44.577174 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:34:44.577483 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] PATH_INFO: `/v3/projects/e51910d8aa6841f98956a451649aa883` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:34:44.578634 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51910d8aa6841f98956a451649aa883)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:34:44.580527 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:34:44.676755 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51910d8aa6841f98956a451649aa883', 'request_id': 'req-6cc7a54a-d70f-4b9e-b542-8838191b80d1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:44.682956 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51910d8aa6841f98956a451649aa883', 'request_id': 'req-6cc7a54a-d70f-4b9e-b542-8838191b80d1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:44.684650 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:34:44.749180 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51910d8aa6841f98956a451649aa883', 'request_id': 'req-6cc7a54a-d70f-4b9e-b542-8838191b80d1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:44.760531 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] The token cache is being invalidate because project e51910d8aa6841f98956a451649aa883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:34:44.760816 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:44.761495 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:44.762989 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1435/2901] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:34:44 2022] DELETE /identity/v3/projects/e51910d8aa6841f98956a451649aa883 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:34:44.767060 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:34:44.768454 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:34:44.781378 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc557680-64cc-47d6-8a89-c6691f2a5d74 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:34:44.836693 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:34:44.837354 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:34:44.838278 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:34:44.838563 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] PATH_INFO: `/v3/users/f51dce593c814b149f19ac904173a6c1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:34:44.839689 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51dce593c814b149f19ac904173a6c1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:34:44.841624 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:34:45.033742 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51dce593c814b149f19ac904173a6c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:45.034875 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51dce593c814b149f19ac904173a6c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:45.047162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51dce593c814b149f19ac904173a6c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:45.054492 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51dce593c814b149f19ac904173a6c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:45.055165 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51dce593c814b149f19ac904173a6c1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:45.132146 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1467/2902] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 17 16:34:44 2022] DELETE /identity/v3/users/f51dce593c814b149f19ac904173a6c1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:34:45.374029 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:34:45.375584 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:34:45.389534 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7a54a-d70f-4b9e-b542-8838191b80d1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:34:45.448266 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff587d68b0de4327bd4c0d90116b3380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a24cdfa264d45f188d3bf7cc23a9da7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:34:45.448903 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:34:45.449181 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:34:45.449480 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] PATH_INFO: `/v3/projects/48fe6810b47843939c2684f248d1d46e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:34:45.450616 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48fe6810b47843939c2684f248d1d46e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:34:45.452568 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:34:45.567355 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48fe6810b47843939c2684f248d1d46e', 'request_id': 'req-66e96a03-1a6b-4f1c-9851-01f774e78a88'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:45.572738 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48fe6810b47843939c2684f248d1d46e', 'request_id': 'req-66e96a03-1a6b-4f1c-9851-01f774e78a88'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:45.647442 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48fe6810b47843939c2684f248d1d46e', 'request_id': 'req-66e96a03-1a6b-4f1c-9851-01f774e78a88'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:45.659693 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] The token cache is being invalidate because project 48fe6810b47843939c2684f248d1d46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:34:45.660022 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:45.660658 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-66e96a03-1a6b-4f1c-9851-01f774e78a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:34:45.662184 dv-cinder-852208-6-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1436/2903] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 17 16:34:45 2022] DELETE /identity/v3/projects/48fe6810b47843939c2684f248d1d46e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:34:55.128350 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=55 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:34:55.656645 dv-cinder-852208-6-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=55 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:36:48.692604 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:36:48.694018 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:36:48.762923 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97a114-9f92-435f-882f-2571b3310619 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:36:48.822300 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda8ae9-753c-4189-aab5-b1227bd614ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da5e1da2196b4ff399921809f40d3002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d22e410ba84b549429f1c9ae1390b0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:36:48.822909 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda8ae9-753c-4189-aab5-b1227bd614ef service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:36:48.823186 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda8ae9-753c-4189-aab5-b1227bd614ef service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:36:48.823457 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda8ae9-753c-4189-aab5-b1227bd614ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:36:48.825162 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0fda8ae9-753c-4189-aab5-b1227bd614ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:36:48.837011 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda8ae9-753c-4189-aab5-b1227bd614ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:36:48.838626 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda8ae9-753c-4189-aab5-b1227bd614ef service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:36:48.849390 dv-cinder-852208-6-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1468/2904] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 17 16:36:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:36:58.844993 dv-cinder-852208-6-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=58 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}